-- Logs begin at Tue 2022-10-11 12:47:33 UTC, end at Tue 2022-10-11 13:52:54 UTC. -- Oct 11 13:18:31.221315 dv-cinder-850618-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 13:18:31.230119 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 13:18:31 2022] *** Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: nodename: dv-cinder-850618-5-iscsi Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: machine: x86_64 Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: clock source: unix Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: pcre jit disabled Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: detected number of CPU cores: 4 Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: current working directory: / Oct 11 13:18:31.232084 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: detected binary path: /usr/bin/uwsgi-core Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: your processes number limit is 47680 Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: your memory page size is 4096 bytes Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: detected max file descriptor number: 2048 Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: lock engine: pthread robust mutexes Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: thunder lock: enabled Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 13:18:31.232675 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 13:18:31.270709 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: Python main interpreter initialized at 0x55ebf39819c0 Oct 11 13:18:31.270709 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: python threads support enabled Oct 11 13:18:31.270709 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: your server socket listen backlog is limited to 100 connections Oct 11 13:18:31.270709 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: your mercy for graceful operations on workers is 90 seconds Oct 11 13:18:31.271129 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 13:18:31.271129 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: *** Operational MODE: preforking *** Oct 11 13:18:31.271350 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: *** uWSGI is running in multiple interpreter mode *** Oct 11 13:18:31.271350 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: spawned uWSGI master process (pid: 103644) Oct 11 13:18:31.271543 dv-cinder-850618-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 13:18:31.272672 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: spawned uWSGI worker 1 (pid: 103645, cores: 1) Oct 11 13:18:31.272672 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: spawned uWSGI worker 2 (pid: 103646, cores: 1) Oct 11 13:18:31.272672 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 13:18:31.910552 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:18:31.913641 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:18:32.959249 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:18:32.959249 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: from cryptography.utils import int_from_bytes Oct 11 13:18:32.959868 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:18:32.959868 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: from cryptography.utils import int_from_bytes Oct 11 13:18:32.961827 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:18:32.961827 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: from cryptography.utils import int_from_bytes Oct 11 13:18:32.962284 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:18:32.962284 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: from cryptography.utils import int_from_bytes Oct 11 13:18:35.398472 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:18:35.399188 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:18:35.399543 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:18:35.399635 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:18:35.399705 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:18:35.399783 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:18:35.399849 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:18:35.399925 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:18:35.400001 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:18:35.400067 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:18:35.400167 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.400250 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.400453 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.400550 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.400781 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.400913 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401055 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401156 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401401 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401532 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401665 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.401990 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402151 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402298 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402390 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402609 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402703 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402839 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.402935 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403161 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403262 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403475 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-5-iscsi {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403573 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-5-iscsi {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403783 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.403872 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404076 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404236 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404384 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404471 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404692 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404787 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.404988 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.405075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.405298 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.405384 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.405599 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.405692 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.406068 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.406245 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407286 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407396 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407468 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407533 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407605 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407672 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407744 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407819 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407887 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.407958 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408024 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408100 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408335 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408425 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408604 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408743 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.408918 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409141 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409320 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409452 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-5-iscsi {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409730 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-5-iscsi {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.409885 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410034 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410180 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410294 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410482 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410589 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410879 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.410981 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411180 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411268 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411478 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411563 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411787 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.411873 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412100 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412221 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412424 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412522 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412739 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.412841 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413049 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413135 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413357 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413442 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413667 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413760 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.413960 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414045 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414257 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414341 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414570 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414675 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414859 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.414945 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415158 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415250 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415448 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415541 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415688 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415773 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.415982 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416068 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416316 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416419 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416626 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416722 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.416936 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417027 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417180 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417274 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417423 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417559 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417724 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.417818 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418030 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418118 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418331 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418438 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418739 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.418921 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419024 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419213 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419311 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419511 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419600 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419804 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.419902 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420101 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420220 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420422 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420499 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420715 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.420814 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421020 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421105 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421331 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421425 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421625 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421718 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.421963 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422049 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422351 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422455 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422594 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422687 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422893 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.422987 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423319 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423531 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423617 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423832 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.423926 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424155 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424259 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424475 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424560 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424772 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.424865 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425071 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425163 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425367 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425453 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425676 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425773 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.425994 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426129 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426289 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426375 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426530 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426615 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426825 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.426919 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427116 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427210 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427426 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427513 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427719 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.427804 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428015 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428099 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428337 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428489 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428628 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428713 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.428923 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429009 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429218 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429305 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429513 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429604 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429810 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.429895 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430104 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430188 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430399 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430484 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430693 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430785 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.430985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431083 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431280 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431372 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431571 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431667 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431878 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.431964 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432204 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432315 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432505 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432614 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432797 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.432890 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433090 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433387 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433480 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433691 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433775 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.433988 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434073 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434279 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434376 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434588 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434674 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.434881 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435003 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435175 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435268 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435480 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435564 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435775 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.435867 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436069 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436207 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436399 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436484 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436691 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436775 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.436983 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437076 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437288 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437372 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437634 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437720 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.437930 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438016 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438221 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438306 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438514 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438595 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438803 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.438885 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439098 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439191 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439391 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439477 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439682 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439767 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.439973 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440057 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440304 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440389 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440616 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440703 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440915 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.440995 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441207 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441301 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441500 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441584 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441805 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.441890 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:18:35.442129 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.442223 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.442450 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.442549 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.442780 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.442875 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443082 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443176 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443400 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443494 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443718 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.443802 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444023 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444170 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444350 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444438 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444653 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444736 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.444964 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445049 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445267 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445351 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445563 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445862 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.445948 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446169 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446273 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446480 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446575 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446802 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.446889 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447114 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447199 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447424 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447509 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447735 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.447821 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448038 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448153 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448377 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448476 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448693 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.448788 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449001 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449087 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449307 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449427 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449636 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449730 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.449970 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450062 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450274 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450374 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450584 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450682 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.450894 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451001 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451195 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451301 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451492 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451585 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451793 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.451878 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452151 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452253 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452448 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452533 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452759 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.452842 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453104 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453191 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453411 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453496 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453723 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.453808 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454023 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454108 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454324 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454408 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454623 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454709 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.454924 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455010 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455226 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455311 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455546 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455630 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455851 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.455936 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456177 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456264 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456486 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456570 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456790 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.456877 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457093 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457177 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457395 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457489 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457694 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457780 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.457989 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458074 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458283 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458385 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458574 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458666 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458868 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.458954 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459163 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459255 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459456 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459540 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459764 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.459847 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460078 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460215 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460397 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460490 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460718 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.460802 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461013 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461099 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461315 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461401 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461611 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461703 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.461910 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462003 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462202 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462286 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462503 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462599 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462799 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.462884 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463095 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463183 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463403 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463487 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463704 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463798 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.463999 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464084 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464335 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464433 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464631 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464717 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.464927 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465014 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465232 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465325 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465615 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465828 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.465915 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466130 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466269 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466427 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466516 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466740 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.466829 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467042 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467138 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467343 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467428 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467662 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467746 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.467983 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468070 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468311 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468399 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468649 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468733 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.468974 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469062 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469287 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469373 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469587 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469674 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469890 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.469976 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470186 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470272 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470486 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470579 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.470879 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471076 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471160 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471369 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471462 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471665 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471750 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.471957 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472041 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472276 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472385 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472572 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472658 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472882 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.472968 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473182 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473317 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473473 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473559 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473768 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.473852 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474060 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474156 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474388 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474474 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474685 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.474770 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475014 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475100 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475336 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475419 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475643 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475729 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.475955 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476045 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476281 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476370 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476587 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476672 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476888 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.476974 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477185 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477269 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477486 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477572 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477784 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.477870 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478093 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478185 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478392 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478477 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478697 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478783 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.478998 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479082 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479309 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479401 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479609 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479695 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.479918 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480003 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480232 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480330 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480537 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480623 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480863 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.480948 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481181 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481275 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481485 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481569 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481791 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.481878 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482092 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482189 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482396 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482483 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482690 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482782 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.482990 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483078 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483290 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483384 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483586 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483682 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.483915 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484041 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484217 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484369 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484574 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484660 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484876 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.484961 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485191 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485277 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485491 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485576 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485797 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.485883 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486090 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486177 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486393 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486479 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486708 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.486830 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487029 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487123 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487331 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487425 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487629 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487724 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.487939 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488032 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488266 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488381 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488569 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488656 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488868 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.488953 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489166 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489259 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489460 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489545 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489760 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.489847 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490064 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490157 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490366 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490452 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490667 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490754 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.490962 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491048 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491263 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491347 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491561 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491653 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491858 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.491944 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492176 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492264 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492483 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492570 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492794 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.492881 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493095 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493180 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493405 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493497 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493717 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.493805 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494012 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494096 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494303 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494395 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494615 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494715 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.494913 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495006 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495207 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495300 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495498 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495583 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495794 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.495879 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496134 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496239 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496445 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496529 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496740 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.496837 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497046 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497211 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497356 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497441 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497654 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497739 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.497959 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498045 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498254 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498342 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498551 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498640 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498862 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.498948 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499162 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499254 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499461 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499549 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499761 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.499848 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500083 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500198 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500406 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500706 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.500792 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501012 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501105 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501310 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501408 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501612 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501733 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.501907 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502037 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502199 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502293 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502498 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502584 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502804 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.502889 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.503359 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.503456 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.503685 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.503779 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.503994 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504081 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504328 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504427 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504665 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504761 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.504976 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505294 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505386 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505611 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505714 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.505915 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506002 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506214 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506300 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506517 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506655 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506813 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.506899 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507111 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507197 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507415 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507508 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507710 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.507803 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508008 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508099 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508326 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508413 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508628 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508714 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.508923 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509010 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509217 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509339 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509510 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509606 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509805 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.509897 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510109 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510195 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510401 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510485 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510701 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510787 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.510995 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511082 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511305 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511398 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511603 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511705 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511899 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.511990 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512221 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512322 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512519 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512611 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512850 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.512935 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513143 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513227 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513469 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513564 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513785 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.513875 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514114 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514206 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514409 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514497 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514703 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.514788 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515018 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515102 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515309 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515398 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515653 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515762 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.515945 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516040 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516267 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516356 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516568 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516654 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516861 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.516948 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517159 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517251 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517456 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517585 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517756 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.517843 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518057 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518143 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518349 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518433 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518647 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518741 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.518941 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.519026 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.519242 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.519326 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.519541 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.519637 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520184 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520272 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520476 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520560 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520775 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.520942 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521074 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521160 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521362 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521455 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521661 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521755 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.521953 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522047 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522257 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522355 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522548 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522635 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522842 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.522928 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523134 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523228 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523432 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523519 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523730 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.523815 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524023 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524108 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524355 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524442 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524654 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524740 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.524951 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525036 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525242 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525336 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525542 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525626 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525833 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.525930 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526127 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526213 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526427 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526518 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526733 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.526874 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527041 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527129 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527334 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527423 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527635 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527734 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.527928 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528012 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528248 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528337 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528542 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528643 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528839 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.528925 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529131 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529217 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529426 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529560 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529720 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.529805 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530013 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530097 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530309 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530403 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530619 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530706 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.530917 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531002 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531235 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531326 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531532 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531617 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531827 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.531912 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532184 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532274 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532483 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532567 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532833 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.532927 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533130 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533215 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533435 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533521 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533740 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.533837 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534043 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534130 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534343 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534428 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534646 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534740 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.534944 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535063 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535247 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535331 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535546 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535645 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535847 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.535933 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536164 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536255 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536456 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536544 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536768 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.536860 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537067 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537152 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537367 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537453 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537672 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537764 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.537982 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538074 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538293 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538380 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538584 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538668 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538884 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.538968 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539184 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539276 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539482 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539567 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539777 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.539862 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540076 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540175 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540401 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540487 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540705 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.540803 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541006 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541098 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541303 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541388 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541700 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541899 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.541984 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542195 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542288 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542586 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542786 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.542870 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543099 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543184 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543396 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543482 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543691 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543778 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.543988 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544072 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544305 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544392 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544606 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544691 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544902 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.544987 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.545311 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.545397 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.545615 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.545700 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.545918 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546004 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546212 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546297 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546513 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546598 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.546905 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547037 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547218 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547313 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547528 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547613 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547830 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.547924 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.548262 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.548353 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.548572 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.548662 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.548877 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549045 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549175 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549261 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549472 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549564 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549762 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.549856 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550065 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550152 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550395 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550482 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550675 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550768 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.550966 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551051 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551260 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551344 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551566 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551652 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551862 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.551947 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552197 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552286 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552602 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552688 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552900 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.552984 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553195 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553288 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553595 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553681 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553894 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.553986 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554194 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554306 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554502 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554589 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554813 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.554900 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555129 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555215 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555427 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555514 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555732 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.555820 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556032 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556136 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556369 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556467 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556683 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556775 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.556983 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557074 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557288 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557381 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557580 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557665 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557892 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.557979 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558200 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558297 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558504 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558590 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558811 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.558903 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559210 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559367 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559520 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559606 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559822 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.559913 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560159 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560250 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560473 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560559 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560771 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.560857 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561063 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561149 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561362 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561447 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561657 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561742 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.561952 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562045 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562264 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562414 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562588 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562683 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562887 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.562971 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563187 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563271 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563481 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563573 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563775 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.563861 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564068 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564166 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564407 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564502 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564703 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.564788 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565016 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565109 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565321 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565416 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565634 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565720 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.565942 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566026 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566240 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566333 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566548 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566633 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566848 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.566934 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.567141 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.567272 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.567436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.567548 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570275 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570437 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570562 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570670 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570775 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570880 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.570985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571090 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571214 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571321 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571426 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571530 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571634 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571751 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571857 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.571970 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572077 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572206 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572313 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572430 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572537 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572642 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572767 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572859 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.572941 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573029 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573110 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573188 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573267 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573345 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573423 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573509 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573591 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573669 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573747 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573825 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573915 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.573996 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574164 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574245 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574322 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574402 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574488 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574569 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574646 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574724 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574801 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574891 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.574977 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575065 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575142 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575344 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575431 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575642 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575729 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.575939 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576026 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576256 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576359 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576589 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576677 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576887 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.576980 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577205 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577298 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577506 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577600 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577818 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.577947 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578179 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578284 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578489 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578582 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578796 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.578882 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579102 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579196 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579411 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579496 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579715 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.579805 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580043 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580217 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580346 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580441 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580655 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580743 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.580961 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.581048 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.581268 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.581353 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.581778 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.581864 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582099 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582186 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582404 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582490 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582708 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.582793 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583010 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583097 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583310 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583395 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583612 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583707 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583914 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.583999 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584239 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584377 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584545 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584666 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584845 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.584957 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585168 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585278 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585479 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585599 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585796 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.585908 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586118 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586229 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586428 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586543 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586735 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.586846 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587036 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587147 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587334 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587442 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587673 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587788 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.587976 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588096 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588296 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588419 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588715 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.588945 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589036 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589198 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589283 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589499 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589595 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589797 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.589882 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590135 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590286 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590406 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590505 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590705 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.590799 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591004 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591089 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591306 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591398 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591608 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591693 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.591922 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592278 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592387 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592597 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592683 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592907 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.592993 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.593214 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.593302 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.593518 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.593623 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594052 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594141 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594359 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594453 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594682 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.594768 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595000 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595085 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595313 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595407 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595619 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595705 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.595926 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596012 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596266 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596356 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596568 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596654 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596862 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.596962 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597162 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597256 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597462 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597548 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597756 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.597850 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598065 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598150 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598367 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598453 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598664 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598757 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.598972 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.599058 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.599271 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.599363 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.599787 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.599882 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600209 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600320 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600451 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600538 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600767 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.600855 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601078 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601163 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601385 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601469 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601678 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601771 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.601992 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602085 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602286 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602371 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602582 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602669 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602889 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.602974 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603191 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603284 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603483 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603577 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603777 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.603864 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604078 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604195 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604399 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604493 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604691 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604785 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.604995 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605098 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605288 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605380 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605689 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605898 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.605993 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606189 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606281 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606484 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606569 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606780 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.606867 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607161 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607367 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607453 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607663 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607749 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.607953 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608038 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608277 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608367 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608571 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608660 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.608871 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609006 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609161 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609286 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609556 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609643 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.609914 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610001 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610212 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610311 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610510 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610606 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610817 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.610903 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611114 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611209 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611407 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611494 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611714 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.611800 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612018 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612138 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612359 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612445 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612663 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612749 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.612964 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.613104 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.613295 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.613382 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.613602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.613688 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614121 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614216 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614443 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614530 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614756 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.614841 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615081 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615176 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615401 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615488 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615700 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615787 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.615997 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616085 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616318 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616406 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616634 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616719 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.616935 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617023 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617239 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617326 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617544 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617653 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617843 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.617930 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618144 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618381 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618469 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618694 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618782 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.618997 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619119 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619300 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619389 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619600 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619687 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619895 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.619980 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620224 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620325 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620534 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620656 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620837 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.620929 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621133 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621241 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621437 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621525 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621760 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.621845 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622071 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622166 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622377 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622462 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622683 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622770 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.622988 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623076 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623286 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623371 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623586 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623678 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623882 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.623971 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624208 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624310 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624519 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624606 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624862 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.624954 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.625173 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.625259 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.625468 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.625852 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626127 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626214 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626436 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626522 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626748 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.626847 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627053 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627139 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627352 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627438 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627666 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627761 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.627969 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628063 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628295 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628383 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628600 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628687 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628901 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.628987 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629225 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629322 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629544 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629631 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629860 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.629951 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630154 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630253 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630456 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630544 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630752 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.630847 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631044 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631130 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631343 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631430 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631644 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631729 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.631946 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632041 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632261 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632361 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632556 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632641 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632852 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.632945 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633146 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633270 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633441 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633529 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633737 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.633832 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634029 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634115 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634324 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634408 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634613 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634706 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634907 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.634992 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635198 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635288 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635676 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635788 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.635873 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636061 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636193 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636385 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636472 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636677 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636767 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.636973 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637059 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637266 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637351 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637560 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637652 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637853 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.637938 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638171 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638259 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638487 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638571 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638790 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.638883 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639093 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639179 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639392 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639489 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639698 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639792 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.639997 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.640083 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.640335 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.640423 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.640699 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.640813 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641011 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641107 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641310 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641398 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641627 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641728 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.641926 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642012 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642228 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642313 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642531 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642619 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642832 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.642925 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643129 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643215 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643432 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643526 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643749 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.643835 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.644046 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.644219 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.644387 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.644471 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.644991 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645093 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645301 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645396 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645607 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645693 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645911 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.645996 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646213 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646306 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646526 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646613 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646827 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.646912 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647128 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647224 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647427 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647520 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647730 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.647817 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648027 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648132 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648358 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648445 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648708 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648848 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.648971 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649060 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649280 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649390 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649601 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649699 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.649916 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650005 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650225 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650319 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650530 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650623 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650848 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.650936 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651262 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651481 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651576 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651790 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.651876 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652155 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652246 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652455 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652555 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652759 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.652845 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.653059 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.653151 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.653298 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103646) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:18:35.653399 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:18:35.653575 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:18:35.808009 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO dbcounter [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Registered counter for database nova_api Oct 11 13:18:35.808272 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Registered counter for database nova_api Oct 11 13:18:35.831657 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_db.sqlalchemy.engines [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.833432 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.839055 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writer thread running {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:35.840820 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:35.895376 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.context [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04d9bc84-21d2-469d-9af3-0dd87dba8b1a(cell1) {{(pid=103646) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:18:35.896446 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.context [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04d9bc84-21d2-469d-9af3-0dd87dba8b1a(cell1) {{(pid=103645) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:18:35.899388 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:18:35.899799 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:18:35.900292 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:18:35.900758 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:18:35.901412 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:18:35.902136 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:18:35.902269 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:18:35.902579 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:18:35.903007 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:18:35.903444 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:18:35.904592 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:18:35.905441 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:18:35.906688 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO dbcounter [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Registered counter for database nova_cell0 Oct 11 13:18:35.907485 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Registered counter for database nova_cell0 Oct 11 13:18:35.910849 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO dbcounter [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Registered counter for database nova_cell1 Oct 11 13:18:35.911437 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Registered counter for database nova_cell1 Oct 11 13:18:35.918461 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_db.sqlalchemy.engines [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.920698 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_db.sqlalchemy.engines [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.925144 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.925966 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:35.926066 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writer thread running {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:35.932921 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:35.934408 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:36.060414 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writer thread running {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:36.070569 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO dbcounter [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Registered counter for database nova_cell0 Oct 11 13:18:36.075110 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Registered counter for database nova_cell0 Oct 11 13:18:36.079832 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_db.sqlalchemy.engines [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103646) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:36.082331 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:18:36.085444 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writer thread running {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:36.087441 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:18:36.414575 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: WARNING keystonemiddleware.auth_token [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:18:36.417136 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:18:36.421718 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: WARNING keystonemiddleware.auth_token [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:18:36.424460 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:18:36.757266 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: WARNING keystonemiddleware.auth_token [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:18:36.763198 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: WARNING keystonemiddleware.auth_token [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:18:36.763945 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:18:36.768506 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ebf39819c0 pid: 103646 (default app) Oct 11 13:18:36.770285 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-057b2288-e905-4dd4-aa7a-c2e6acf068b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:18:36.770860 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:18:36.772038 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002032 Oct 11 13:18:36.772480 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Tue Oct 11 13:18:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:18:36.775519 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ebf39819c0 pid: 103645 (default app) Oct 11 13:19:57.347860 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:19:57.348885 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 11 13:19:57.349467 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:19:57.362077 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:57.363198 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell0:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:57.363899 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell1:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:57.366064 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:19:58.292531 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-54ae39ab-e3b7-4f3b-b2c7-13e79754bada admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:19:58.329290 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-54ae39ab-e3b7-4f3b-b2c7-13e79754bada admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.972712 Oct 11 13:19:58.330137 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 11 13:19:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:00.878755 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:00.879747 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-4a30801c-5f30-4f79-a6d8-6be866026075 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 11 13:20:00.885022 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:01.343292 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-0780bb0d-6890-4c5b-8c9c-048cb59b1b05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:01.390277 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-0780bb0d-6890-4c5b-8c9c-048cb59b1b05 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503818 Oct 11 13:20:01.390840 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:01.404770 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_api:SELECT=3 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:01.405684 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_cell0:SELECT=3 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:01.407608 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_cell1:SELECT=3 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:01.408381 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:01.614125 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-394f116a-f797-4a04-8358-56b98731edc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:01.682528 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-394f116a-f797-4a04-8358-56b98731edc4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282885 Oct 11 13:20:01.682999 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 11 13:20:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:04.240088 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-0780bb0d-6890-4c5b-8c9c-048cb59b1b05 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:04.241138 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-0780bb0d-6890-4c5b-8c9c-048cb59b1b05 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Oct 11 13:20:04.241520 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:04.892315 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-0f4e8e35-4e57-4da3-b418-c6bbc42b95c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:04.931650 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-0f4e8e35-4e57-4da3-b418-c6bbc42b95c7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683717 Oct 11 13:20:04.938918 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:20:04.945106 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-f2a7ea59-83a2-462b-9ec5-970945477004 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:04.987430 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-f2a7ea59-83a2-462b-9ec5-970945477004 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045922 Oct 11 13:20:04.988170 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 11 13:20:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:07.547605 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-0f4e8e35-4e57-4da3-b418-c6bbc42b95c7 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:07.548658 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-0f4e8e35-4e57-4da3-b418-c6bbc42b95c7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Oct 11 13:20:07.549104 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:07.965124 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-676755b8-efb7-4d06-b459-6f6bb4caef34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:07.987118 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-676755b8-efb7-4d06-b459-6f6bb4caef34 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430944 Oct 11 13:20:07.987671 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:07.999888 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-c3df3b17-7f53-49c6-ae20-92c20dd2d49f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:08.028706 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-c3df3b17-7f53-49c6-ae20-92c20dd2d49f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032338 Oct 11 13:20:08.029469 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 11 13:20:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:10.622819 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-676755b8-efb7-4d06-b459-6f6bb4caef34 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:10.623906 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-676755b8-efb7-4d06-b459-6f6bb4caef34 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Oct 11 13:20:10.625138 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:11.039153 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-6011d65b-bd5a-41c0-901d-c9e60ae1f9d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:11.058370 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-6011d65b-bd5a-41c0-901d-c9e60ae1f9d7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427744 Oct 11 13:20:11.059193 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:20:11.071520 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-b2b65c18-e2de-4a10-a4b5-824750d34c2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:11.103723 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-b2b65c18-e2de-4a10-a4b5-824750d34c2c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036247 Oct 11 13:20:11.104319 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 11 13:20:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:13.652993 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-6011d65b-bd5a-41c0-901d-c9e60ae1f9d7 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:13.654327 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-6011d65b-bd5a-41c0-901d-c9e60ae1f9d7 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Oct 11 13:20:13.654717 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:20:14.130774 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "swap": 0}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:14.150705 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488535 Oct 11 13:20:14.151379 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:14.163474 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-acda47d1-c503-4f31-bb16-d98cfd90f09f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:14.188781 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-acda47d1-c503-4f31-bb16-d98cfd90f09f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028962 Oct 11 13:20:14.189354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 11 13:20:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:16.719390 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:16.720738 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Oct 11 13:20:16.721296 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:17.119482 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-213c6c8e-368a-492d-8f4b-67e7730de58e admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:17.145236 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-213c6c8e-368a-492d-8f4b-67e7730de58e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.415240 Oct 11 13:20:17.145706 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 11 13:20:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:19.847021 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:19.848068 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-d4a5b717-2013-4d07-aa77-e296da931025 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 11 13:20:19.848509 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:20.260511 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-0a02aaf4-bdd3-4f41-a55c-da0804d21251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:20.282928 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-0a02aaf4-bdd3-4f41-a55c-da0804d21251 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.426831 Oct 11 13:20:20.283476 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:20.295480 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-dd7a457b-e7fe-4ac3-b0b8-92361ea41713 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:20.323802 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-dd7a457b-e7fe-4ac3-b0b8-92361ea41713 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031972 Oct 11 13:20:20.324429 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 11 13:20:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:22.914966 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-0a02aaf4-bdd3-4f41-a55c-da0804d21251 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:22.915960 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-0a02aaf4-bdd3-4f41-a55c-da0804d21251 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 11 13:20:22.916351 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:23.310061 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-5c22ff31-9c1f-4ab7-b074-6ea43c1284be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:23.329642 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-5c22ff31-9c1f-4ab7-b074-6ea43c1284be admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406610 Oct 11 13:20:23.330188 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:23.342700 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-f0e18407-db89-4217-a823-d00bab425716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:23.367420 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-f0e18407-db89-4217-a823-d00bab425716 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028582 Oct 11 13:20:23.367998 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 11 13:20:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:20:25.941776 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-5c22ff31-9c1f-4ab7-b074-6ea43c1284be admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:25.943454 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-5c22ff31-9c1f-4ab7-b074-6ea43c1284be admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Oct 11 13:20:25.943855 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:26.372520 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-b11e6f0f-7904-49e4-82ca-d120abf6c761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:26.394754 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-b11e6f0f-7904-49e4-82ca-d120abf6c761 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.444774 Oct 11 13:20:26.395305 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:26.407988 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a4b112be-0d76-41bf-8ac4-fca08a976a59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:26.440887 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-a4b112be-0d76-41bf-8ac4-fca08a976a59 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037037 Oct 11 13:20:26.441645 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 11 13:20:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:29.004968 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-b11e6f0f-7904-49e4-82ca-d120abf6c761 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:29.005959 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-b11e6f0f-7904-49e4-82ca-d120abf6c761 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 11 13:20:29.012203 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:29.433455 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-4099a7ce-633e-4868-b7bf-dfcb5d00f0ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "disk": 80, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:29.439018 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:29.460230 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-4099a7ce-633e-4868-b7bf-dfcb5d00f0ec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447154 Oct 11 13:20:29.460787 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:20:29.472973 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-1767d808-f156-471a-8231-077e5329fdbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:29.496579 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-1767d808-f156-471a-8231-077e5329fdbf admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027146 Oct 11 13:20:29.497153 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 11 13:20:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:32.044487 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-4099a7ce-633e-4868-b7bf-dfcb5d00f0ec admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:32.045497 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-4099a7ce-633e-4868-b7bf-dfcb5d00f0ec admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 11 13:20:32.046101 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:32.470746 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "disk": 160, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:32.478730 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:32.494004 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.441673 Oct 11 13:20:32.494684 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 11 13:20:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:32.509269 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-52cff5f8-1963-440a-902f-cefd9ad37202 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:32.534008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-52cff5f8-1963-440a-902f-cefd9ad37202 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028316 Oct 11 13:20:32.534700 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 11 13:20:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:20:49.460003 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:49.461627 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002317 Oct 11 13:20:49.462281 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:49.473632 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:20:49.886752 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-6c2fd278-1b5a-482c-bf4f-413e36d9bdf0 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:49.905567 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-6c2fd278-1b5a-482c-bf4f-413e36d9bdf0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.436442 Oct 11 13:20:49.906091 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 11 13:20:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:20:51.209504 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:51.210492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-ced1b56a-58b3-4c2e-8a6f-3af67f3de66b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 11 13:20:51.210901 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:51.770947 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a91cd689-7fb1-411a-b60c-5861d9b275f6 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:51.777305 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-a91cd689-7fb1-411a-b60c-5861d9b275f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a91cd689-7fb1-411a-b60c-5861d9b275f6 admin admin] Request method failure captured: Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept: application/json Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Connection: keep-alive Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Content-Length: 0 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Host: 10.222.0.15 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABjRW2zo6OLle2Dk2bFdhvnqvQveBxdUuqU7app5zZEAolKMKqmYSjGJgftEMHdT80DTxpLEdA6zW6IJH55LJY_Abf8VtJb2Uf_CwVD5zdmRP324kyIb2H9gQhouv0B1XM61_qoFlgRlkQAOl2X653j1F4saMvfBK2OlgaFyERGgEzhuLc Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Oct 11 13:20:51.780529 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant: admin Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User: admin Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Name: admin Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: method: > Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: exception: Flavor 42 could not be found. Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: action_args: {'id': '42'} Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:51.782008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:51.782985 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.784251 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a91cd689-7fb1-411a-b60c-5861d9b275f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:51.785506 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-a91cd689-7fb1-411a-b60c-5861d9b275f6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.432970 Oct 11 13:20:51.785506 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 11 13:20:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:51.792147 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-2164b93a-9573-41ea-813a-3664882bb519 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:51.814788 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-2164b93a-9573-41ea-813a-3664882bb519 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026210 Oct 11 13:20:51.815366 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:51.830043 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a20768f6-bdea-4366-8e80-96567f5873f2 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:51.855398 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-a20768f6-bdea-4366-8e80-96567f5873f2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033027 Oct 11 13:20:51.855921 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:51.867820 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-e3e81e74-3a81-4506-98d9-e46531805376 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:51.873489 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.wsgi [None req-e3e81e74-3a81-4506-98d9-e46531805376 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-e3e81e74-3a81-4506-98d9-e46531805376 admin admin] Request method failure captured: Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept: application/json Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept-Encoding: gzip, deflate Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Connection: keep-alive Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Content-Length: 0 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Host: 10.222.0.15 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-System-Scope: None Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: User-Agent: python-novaclient Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Auth-Token: gAAAAABjRW2zo6OLle2Dk2bFdhvnqvQveBxdUuqU7app5zZEAolKMKqmYSjGJgftEMHdT80DTxpLEdA6zW6IJH55LJY_Abf8VtJb2Uf_CwVD5zdmRP324kyIb2H9gQhouv0B1XM61_qoFlgRlkQAOl2X653j1F4saMvfBK2OlgaFyERGgEzhuLc Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Id: None Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Name: None Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Identity-Status: Confirmed Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Is-Admin-Project: True Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Id: default Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Name: Default Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Name: admin Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Role: admin,reader,member Oct 11 13:20:51.876808 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Roles: admin,reader,member Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant: admin Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Name: admin Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User: admin Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Id: default Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Name: Default Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Name: admin Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: method: > Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: exception: Flavor 42 could not be found. Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: action_args: {'id': '42'} Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:51.878243 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:51.879183 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:51.880436 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-e3e81e74-3a81-4506-98d9-e46531805376 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:51.881398 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-e3e81e74-3a81-4506-98d9-e46531805376 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014012 Oct 11 13:20:51.881398 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 11 13:20:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:53.094102 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-a20768f6-bdea-4366-8e80-96567f5873f2 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:53.095503 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-a20768f6-bdea-4366-8e80-96567f5873f2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002494 Oct 11 13:20:53.096101 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:53.662500 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-806cf721-6bbe-4ec3-a048-4cb27da6f2bc admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:53.667813 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.wsgi [None req-806cf721-6bbe-4ec3-a048-4cb27da6f2bc admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-806cf721-6bbe-4ec3-a048-4cb27da6f2bc admin admin] Request method failure captured: Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept: application/json Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept-Encoding: gzip, deflate Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Connection: keep-alive Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Content-Length: 0 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Host: 10.222.0.15 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-System-Scope: None Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: User-Agent: python-novaclient Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Auth-Token: gAAAAABjRW20Vapqy3VWXlC3wezsRIa-k3SqTHbVZjRPKYDHPLHpYwwOANQhOYH0Xx9l8KeD0C8atoW4OQ3WblSZBIKVdIPvAMIq1Pl6-bLinoC0TREkrzIiK32nrSCZpR-EH3squiUYakgcE22aImv7vGAAK59IY6S5IIDvNJDJqxtyOIzo7pY Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Id: None Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Name: None Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Identity-Status: Confirmed Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Is-Admin-Project: True Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Id: default Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Name: Default Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Name: admin Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Role: admin,reader,member Oct 11 13:20:53.669354 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Roles: admin,reader,member Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant: admin Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Name: admin Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User: admin Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Id: default Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Name: Default Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Name: admin Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: method: > Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: exception: Flavor 84 could not be found. Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: action_args: {'id': '84'} Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:53.670696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:53.671492 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.672648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-806cf721-6bbe-4ec3-a048-4cb27da6f2bc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:53.673734 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-806cf721-6bbe-4ec3-a048-4cb27da6f2bc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.439461 Oct 11 13:20:53.673734 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 11 13:20:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:53.680731 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-b3af69e5-35ef-4066-aa4d-37be47fc2e73 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:53.695981 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-b3af69e5-35ef-4066-aa4d-37be47fc2e73 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018819 Oct 11 13:20:53.696568 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:53.706086 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-9eccea18-837c-479c-aa2a-f72bda7ff203 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:53.721967 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-9eccea18-837c-479c-aa2a-f72bda7ff203 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019475 Oct 11 13:20:53.722489 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:53.731993 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-aa33a6bc-4f3c-4a12-bf8c-fb0cd4d65806 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:53.737128 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-aa33a6bc-4f3c-4a12-bf8c-fb0cd4d65806 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-aa33a6bc-4f3c-4a12-bf8c-fb0cd4d65806 admin admin] Request method failure captured: Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept: application/json Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Connection: keep-alive Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Content-Length: 0 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Host: 10.222.0.15 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABjRW20Vapqy3VWXlC3wezsRIa-k3SqTHbVZjRPKYDHPLHpYwwOANQhOYH0Xx9l8KeD0C8atoW4OQ3WblSZBIKVdIPvAMIq1Pl6-bLinoC0TREkrzIiK32nrSCZpR-EH3squiUYakgcE22aImv7vGAAK59IY6S5IIDvNJDJqxtyOIzo7pY Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Oct 11 13:20:53.738633 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant: admin Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User: admin Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Name: admin Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: method: > Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: exception: Flavor 84 could not be found. Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: action_args: {'id': '84'} Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:53.740192 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:53.741165 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:53.742419 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-aa33a6bc-4f3c-4a12-bf8c-fb0cd4d65806 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:53.743626 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-aa33a6bc-4f3c-4a12-bf8c-fb0cd4d65806 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011626 Oct 11 13:20:53.743626 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 11 13:20:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:54.961760 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-9eccea18-837c-479c-aa2a-f72bda7ff203 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:54.962946 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-9eccea18-837c-479c-aa2a-f72bda7ff203 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001849 Oct 11 13:20:54.963475 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:55.516820 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-5f00fe5b-adb0-4c14-8332-b6a78f935c42 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:55.523099 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-5f00fe5b-adb0-4c14-8332-b6a78f935c42 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-5f00fe5b-adb0-4c14-8332-b6a78f935c42 admin admin] Request method failure captured: Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept: application/json Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Connection: keep-alive Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Content-Length: 0 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Host: 10.222.0.15 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABjRW22MMTWxRANOAcC4agZdZ49f6WKSSjXQkpjpUIMUNL6zGB9Sh_cOtpaew7lSTW0YMIoIWEMd8yLB44JmF0IFajDPk2XAOEF_ClsN0AKUrpVkFLj0TgoyBntqkM1VsAZ_pJb4JFDrxPJdQZX43nJoSLlISLzijKAKpFrX5NVwWN5gqg Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Oct 11 13:20:55.524627 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant: admin Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User: admin Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: X-User-Name: admin Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: method: > Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: exception: Flavor 451 could not be found. Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: action_args: {'id': '451'} Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:55.526222 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:55.527103 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.528698 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-5f00fe5b-adb0-4c14-8332-b6a78f935c42 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:55.530075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-5f00fe5b-adb0-4c14-8332-b6a78f935c42 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.421719 Oct 11 13:20:55.530075 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:20:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 13:20:55.536402 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-195067ed-1cfc-4ef4-b41d-9b2ce0f8677a admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:55.552130 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-195067ed-1cfc-4ef4-b41d-9b2ce0f8677a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019306 Oct 11 13:20:55.552648 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:20:55.563501 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:55.578654 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018612 Oct 11 13:20:55.579202 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 11 13:20:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:20:55.588677 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-21e83e1d-352c-4382-a49e-d6974297bec2 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:55.594211 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.wsgi [None req-21e83e1d-352c-4382-a49e-d6974297bec2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-21e83e1d-352c-4382-a49e-d6974297bec2 admin admin] Request method failure captured: Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept: application/json Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Accept-Encoding: gzip, deflate Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Connection: keep-alive Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Content-Length: 0 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Host: 10.222.0.15 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-Api-Version: compute 2.92 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Openstack-System-Scope: None Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: User-Agent: python-novaclient Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Auth-Token: gAAAAABjRW22MMTWxRANOAcC4agZdZ49f6WKSSjXQkpjpUIMUNL6zGB9Sh_cOtpaew7lSTW0YMIoIWEMd8yLB44JmF0IFajDPk2XAOEF_ClsN0AKUrpVkFLj0TgoyBntqkM1VsAZ_pJb4JFDrxPJdQZX43nJoSLlISLzijKAKpFrX5NVwWN5gqg Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Id: None Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Domain-Name: None Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Identity-Status: Confirmed Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Is-Admin-Project: True Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Id: default Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Domain-Name: Default Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Project-Name: admin Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Role: admin,reader,member Oct 11 13:20:55.595780 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Roles: admin,reader,member Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81928fdc604942f18e8f5f0944263250"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81928fdc604942f18e8f5f0944263250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81928fdc604942f18e8f5f0944263250"}]}] Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant: admin Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Id: 81928fdc604942f18e8f5f0944263250 Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-Tenant-Name: admin Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User: admin Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Id: default Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Domain-Name: Default Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Id: c24104e3c5bf48be865c100865a4abd3 Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: X-User-Name: admin Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: method: > Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: exception: Flavor 451 could not be found. Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: action_args: {'id': '451'} Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:20:55.597295 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:55.598230 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: ERROR nova.api.openstack.wsgi Oct 11 13:20:55.599716 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-21e83e1d-352c-4382-a49e-d6974297bec2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:20:55.600964 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-21e83e1d-352c-4382-a49e-d6974297bec2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012061 Oct 11 13:20:55.600964 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:20:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 13:20:56.811678 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:56.812716 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 11 13:20:56.813112 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:57.355585 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-99f047a5-07fa-4a51-a085-f1793f9ffe34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:57.376996 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-99f047a5-07fa-4a51-a085-f1793f9ffe34 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.428071 Oct 11 13:20:57.377464 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 11 13:20:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:20:58.592713 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:20:58.593705 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 11 13:20:58.594108 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:20:59.194888 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-f0d86893-7e5b-4ef6-9703-685c37cc9a49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:20:59.217568 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-f0d86893-7e5b-4ef6-9703-685c37cc9a49 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.472452 Oct 11 13:20:59.218123 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 11 13:20:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:21:00.474602 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:21:00.475608 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 11 13:21:00.476008 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:21:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:21:01.018513 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-668561ec-3112-4dc2-a83f-01a220c38548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:21:01.039754 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-668561ec-3112-4dc2-a83f-01a220c38548 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.427324 Oct 11 13:21:01.040326 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 11 13:21:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:21:02.271276 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:21:02.272326 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 11 13:21:02.272723 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:21:02.827884 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-255d81c8-c3aa-4d8e-bc53-b3a151765347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:21:02.851822 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-255d81c8-c3aa-4d8e-bc53-b3a151765347 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.444392 Oct 11 13:21:02.852366 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 11 13:21:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:21:04.072941 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:21:04.073961 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Oct 11 13:21:04.074353 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:21:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:21:04.622869 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-a0a53545-9ffe-4788-9ff9-1141a1ae97e1 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:21:04.643683 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-a0a53545-9ffe-4788-9ff9-1141a1ae97e1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.434818 Oct 11 13:21:04.644247 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Tue Oct 11 13:21:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:22:01.419498 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.420452 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-40f42a7d-1d19-4ef8-954a-dd55e898bed1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 11 13:22:01.420852 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:22:01.434737 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:01.850514 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-f475cf9c-f1b2-43a0-b2b8-a87164905488 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.871355 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-f475cf9c-f1b2-43a0-b2b8-a87164905488 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441158 Oct 11 13:22:01.871877 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:22:01.893337 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=14 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:22:01.897296 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-413166f2-42e0-4bf3-bd92-ad8989dd5aba admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.904949 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-413166f2-42e0-4bf3-bd92-ad8989dd5aba admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013405 Oct 11 13:22:01.905462 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:22:01.917103 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-1d0c28aa-06ba-4466-9c8a-61e863cc6a7b admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.924322 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-1d0c28aa-06ba-4466-9c8a-61e863cc6a7b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010803 Oct 11 13:22:01.924823 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:22:01.935911 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.943267 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010784 Oct 11 13:22:01.943713 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:22:01.954572 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-721ccf67-5b19-4fa5-b43a-7a793dbc1795 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:22:01.961880 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-721ccf67-5b19-4fa5-b43a-7a793dbc1795 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010656 Oct 11 13:22:01.962392 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Oct 11 13:22:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:25:07.356207 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:07.357227 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 11 13:25:07.357590 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:25:07.497607 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_api:SELECT=6 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:07.671551 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:07.678329 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:07.678960 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:07.679529 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:07.680588 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:07.681192 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:07.681797 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:07.717378 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-58ef0b02-7ba8-43ff-96d8-a35e3e97259f admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.221808 Oct 11 13:25:07.717978 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:25:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:25:08.779784 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:08.780841 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 11 13:25:08.781229 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:25:08.979350 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:08.982767 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:08.983222 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:08.983640 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:08.984360 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:08.984794 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:08.985200 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:09.005135 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-6ce23480-58f3-4c33-b5f0-aa5dee3d264c admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.085530 Oct 11 13:25:09.005696 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:25:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:25:20.495976 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:20.497022 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 11 13:25:20.497418 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:25:20.639894 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_cell0:SELECT=4 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:20.640640 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_cell1:SELECT=4 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:20.641240 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG dbcounter [-] [103646] Writing DB stats nova_api:SELECT=8 {{(pid=103646) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:25:20.696211 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:20.699556 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:20.700023 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:20.700478 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:20.701191 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:20.701623 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:20.702031 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:20.726789 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-e7bad988-d3d0-44f9-9b61-839677f58c2e admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.091426 Oct 11 13:25:20.727329 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:25:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:25:21.802408 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:21.803422 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c6d69078-ab73-41d7-9188-86405fd947cf admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 11 13:25:21.803812 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 11 13:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:25:22.000904 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG nova.api.openstack.wsgi [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Calling method '>' {{(pid=103646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:25:22.004351 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:22.004826 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:22.005245 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:22.005964 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:25:22.006397 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:25:22.006809 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: DEBUG oslo_concurrency.lockutils [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103646) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:25:22.028876 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: INFO nova.api.openstack.requestlog [None req-730449df-a608-4c70-b16b-ee3d7a93cb42 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086445 Oct 11 13:25:22.029442 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: [pid: 103646|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 11 13:25:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:26:18.588514 dv-cinder-850618-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 13:26:18.598823 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: Tue Oct 11 13:26:18 2022 - graceful shutdown triggered... Oct 11 13:26:18.599951 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: Gracefully killing worker 1 (pid: 103645)... Oct 11 13:26:18.600404 dv-cinder-850618-5-iscsi devstack@n-api.service[103646]: Gracefully killing worker 2 (pid: 103646)... Oct 11 13:26:18.725245 dv-cinder-850618-5-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=4 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:26:19.590581 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: worker 1 buried after 1 seconds Oct 11 13:26:19.590581 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: worker 2 buried after 1 seconds Oct 11 13:26:19.590581 dv-cinder-850618-5-iscsi devstack@n-api.service[103644]: goodbye to uWSGI. Oct 11 13:26:19.592187 dv-cinder-850618-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 11 13:26:19.592769 dv-cinder-850618-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 13:26:19.595517 dv-cinder-850618-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 13:26:19.609831 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 13:26:19.612481 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 13:26:19 2022] *** Oct 11 13:26:19.612666 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: nodename: dv-cinder-850618-5-iscsi Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: machine: x86_64 Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: clock source: unix Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: pcre jit disabled Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: detected number of CPU cores: 4 Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: current working directory: / Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: detected binary path: /usr/bin/uwsgi-core Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: your processes number limit is 47680 Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: your memory page size is 4096 bytes Oct 11 13:26:19.615929 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: detected max file descriptor number: 2048 Oct 11 13:26:19.616737 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: lock engine: pthread robust mutexes Oct 11 13:26:19.616737 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: thunder lock: enabled Oct 11 13:26:19.616737 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 13:26:19.616737 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 13:26:19.656988 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: Python main interpreter initialized at 0x5650e801f9c0 Oct 11 13:26:19.656988 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: python threads support enabled Oct 11 13:26:19.656988 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: your server socket listen backlog is limited to 100 connections Oct 11 13:26:19.656988 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: your mercy for graceful operations on workers is 90 seconds Oct 11 13:26:19.657380 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 13:26:19.657456 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: *** Operational MODE: preforking *** Oct 11 13:26:19.657758 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: *** uWSGI is running in multiple interpreter mode *** Oct 11 13:26:19.657758 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: spawned uWSGI master process (pid: 118869) Oct 11 13:26:19.657949 dv-cinder-850618-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 13:26:19.658817 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: spawned uWSGI worker 1 (pid: 118880, cores: 1) Oct 11 13:26:19.658928 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: spawned uWSGI worker 2 (pid: 118881, cores: 1) Oct 11 13:26:19.659106 dv-cinder-850618-5-iscsi devstack@n-api.service[118869]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 13:26:20.317565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:26:20.318404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 13:26:21.449616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:26:21.449616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: from cryptography.utils import int_from_bytes Oct 11 13:26:21.450253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:26:21.450253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: from cryptography.utils import int_from_bytes Oct 11 13:26:21.462564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:26:21.462564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: from cryptography.utils import int_from_bytes Oct 11 13:26:21.463071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 13:26:21.463071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: from cryptography.utils import int_from_bytes Oct 11 13:26:23.824208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:26:23.824922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:26:23.825022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:26:23.825421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:26:23.825694 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:26:23.826565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.826565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.826766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.826938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.827279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.827591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.827917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.828292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.828589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.828853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.829204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.829687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-5-iscsi {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.831050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.831050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.831050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.831050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.832625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.832625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.832625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.832625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.832949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.833162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.833371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.833742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.834047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.834330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.834677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.835030 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.835354 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.835636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.836059 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-5-iscsi {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.836396 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.836703 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.837021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.837448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.837760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.838073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.838393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.838712 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.839019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.839478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.839802 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.840140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.840520 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.840766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.841075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.841384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.841702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.842005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.842308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.842556 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.842864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.843183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.843502 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.843824 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.844073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.844356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.844673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.844990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.845298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.845603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.845907 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.846212 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.846515 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.846818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.847122 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.847430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.847745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.848059 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.848411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.848715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.849032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.849432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.849682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.849992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.850330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.850648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.850953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.851174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 13:26:23.851615 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.851716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 13:26:23.851812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.851906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.851988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 13:26:23.852181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.852353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 13:26:23.852500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.852651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 13:26:23.852786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.852969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.853105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.853922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858369 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858369 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.858982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859122 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.859894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860209 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.860957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-5-iscsi {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861385 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.861985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.862136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.862595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.862752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.862894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.863922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.864857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865755 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.865893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.866920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-5-iscsi {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.867931 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868761 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.868913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.869995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.870944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.871971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.872111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.872287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.872743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.872893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.873042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.873769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.873913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874502 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.874790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.874942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.875083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.875221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.875365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.875512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.875672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.875829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.876248 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.876410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.876569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.876740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.876968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.877111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.877251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.877396 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.877563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.877703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.877843 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.877989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.878179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.878333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.878479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.878617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.878762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.878908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.879078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.879831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.879990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.880171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.880171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.880459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.880607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.880757 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.880911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.881050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.881194 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.881339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.881485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.881641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.881641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.881923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.881923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.882202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.882350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.882514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.882514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.883024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.883024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.883378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.883534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.883682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.883829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.883976 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.884179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.884335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.884490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.884630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.884776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.884925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.885066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.885205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.885353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.885493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.885641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.885780 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.885927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.886086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.886227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.886376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.886515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.886665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.886813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.887034 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.887189 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.887329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.887478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.887625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.887772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.887920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.888078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.888290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.888436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.888575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.888728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.889310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.889750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.889893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.890032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.890187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.890354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.890506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.890652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.890652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.890930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.891078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.891220 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.891359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.891497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.891642 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.891789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.891929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.892074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.892269 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.892411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.892411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.892682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.893461 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.893617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.893767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.893918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.894057 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.894212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.894364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.894519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.894676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.894833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.894981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.895121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.895260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.895407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.895559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.895710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.895849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.895988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.895988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.896279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.896419 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.896598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.896740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.896887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.897035 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.897174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.897174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.897446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.897446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.897711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.897856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.897995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.898142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.898337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.898505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.898645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.898785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.898924 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.899076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.899227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.899368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.899512 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.899652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.899803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.899955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.900103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.900290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.900445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.900596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.900735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.900885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.901025 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.901171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.901309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.901456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.901596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.901784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.901978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.902126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.902285 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.902424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.902578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.902718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 13:26:23.902865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.903159 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.903304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.903604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.903761 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.903903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.904951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.905971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906262 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.906968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907836 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.907989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.908978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909119 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.909985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.910134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.910287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.910430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.910761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.910917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911651 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.911952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912262 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.912998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.913278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.913432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.913717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.913944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.914981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.915862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916194 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916658 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.916991 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.917142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.917290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.917557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.917733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.917906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.918090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.918263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.918491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.918687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.918884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.919941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920679 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.920861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921390 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.921986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.922975 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.923116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.923400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.923558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.923708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.923847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.924983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.925121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.925421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.925612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.925782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.925928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.926938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927809 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.927948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928594 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.928889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.929915 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930502 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930662 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.930949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.931831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932527 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.932954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.933138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.933308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.933598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.933745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.933893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934719 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.934904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935355 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935796 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.935950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936104 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936442 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.936874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937317 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937605 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.937898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.938950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939683 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.939969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.940872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941014 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941320 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941606 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.941974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942486 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.942922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.943966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.944247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.944571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.944720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.944869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.945885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.946915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.947921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.948882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.949973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950124 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950124 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950407 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.950974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951293 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.951875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952185 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.952866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953013 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953469 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.953918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.954895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955780 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.955926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956436 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.956730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.957881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958468 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.958934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959688 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.959977 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.960879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.961898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962706 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.962853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.963900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964729 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.964959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965114 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.965984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966131 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.966885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.967756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968164 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968164 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968164 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.968759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.969306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.969456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.969611 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.969771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.969919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.970852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971320 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.971921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.972983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.973138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.973286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.973453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.973609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.973756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.974863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.975897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.976997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.977167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.977408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.977561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.977716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.977884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978506 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.978954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979114 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.979908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.980980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.981901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.982928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983390 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983537 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.983854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984651 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.984964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.985120 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.985274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.987843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.988019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.988262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.988589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.988747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.988912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.989858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.990841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.991900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992694 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.992842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.993863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.994798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.995921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.996949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997422 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.997885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.998888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999703 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:23.999865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000189 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.000874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001661 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.001975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.002866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.003968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.004142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.004314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.004624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.004774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.004921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005079 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.005843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.006921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.007849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.008955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.009985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.010925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.011902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012408 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.012868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.013877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.014949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.015891 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.016878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.018436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.018642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.018825 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.019992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.020174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.020381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.020564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.020755 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.020944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.021127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.021941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.022903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.023922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.024085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.024269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.024426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.024724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.024724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.025885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.026992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.027965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.028162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.028317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.028507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.028744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.028911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.029886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030678 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.030979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.031902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032707 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.032864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033173 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.033882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.034949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035556 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.035850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.036834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.037725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.038781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.039995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.040163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.040334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.040565 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.040716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.040878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041487 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.041932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.042934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.043952 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.044166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.044323 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.044472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.044631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.044905 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.045973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046755 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.046926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047698 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.047855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048168 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.048946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.049208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.049372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.049534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.049692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.049894 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050373 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050678 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.050834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051635 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.051964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.052978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.053134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.053303 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.053460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.053616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.053764 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.054001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.054787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055354 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.055974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056341 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.056928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057087 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.057843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.058864 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059201 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.059982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.060956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.061249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.061406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.061562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.061718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.061892 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.062905 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.063978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.064233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.064391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.064547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.064710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.064860 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.065898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.066974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.067130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.067285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.067446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.067834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.067992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.068980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.069137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.069294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.069470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.069712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.069866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.070872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.071956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.072937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073369 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.073965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074132 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.074954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075241 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.075968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076634 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.076985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077161 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.077978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.078968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079161 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079729 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.079925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.080909 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081373 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.081839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.082946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.083984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084515 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.084957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085208 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085565 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085644 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.085982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086442 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086533 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.086998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087175 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.087998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088209 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088471 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.088993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089449 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.089822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.090446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.091942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.092063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.092406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.092717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.093025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.093332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.093640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.093946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.094279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.095754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.095754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.095754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.095754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.096044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.096152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.096476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.096802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.097121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.097433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.097767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.098083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.098394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.098709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.099024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.099336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.099647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.099980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.100337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.100651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.100976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.101297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.101619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.101935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.102247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.102576 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.102888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.103199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.103511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.103823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.104222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.104547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.104861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.105270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.105591 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.105937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.106296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.106646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.106990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.107329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.107656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.108058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.108433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.108785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.109149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.109497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.109845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.110155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 13:26:24.110402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118881) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 13:26:24.147096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO dbcounter [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Registered counter for database nova_api Oct 11 13:26:24.170806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.172328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO dbcounter [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Registered counter for database nova_api Oct 11 13:26:24.178760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writer thread running {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.194654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_db.sqlalchemy.engines [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.202294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writer thread running {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.237461 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.context [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04d9bc84-21d2-469d-9af3-0dd87dba8b1a(cell1) {{(pid=118880) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:26:24.241594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:26:24.242076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:26:24.243658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:26:24.244425 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:26:24.244871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:26:24.246871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:26:24.248940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO dbcounter [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Registered counter for database nova_cell0 Oct 11 13:26:24.253099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO dbcounter [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Registered counter for database nova_cell1 Oct 11 13:26:24.258872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.context [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04d9bc84-21d2-469d-9af3-0dd87dba8b1a(cell1) {{(pid=118881) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 13:26:24.261772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.262599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.263220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:26:24.263713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:26:24.265379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:26:24.266118 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:26:24.266567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:26:24.268607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writer thread running {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.269075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:26:24.271115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writer thread running {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.271231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO dbcounter [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Registered counter for database nova_cell0 Oct 11 13:26:24.275251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO dbcounter [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Registered counter for database nova_cell1 Oct 11 13:26:24.282951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_db.sqlalchemy.engines [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.285195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_db.sqlalchemy.engines [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.289918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writer thread running {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.417661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO dbcounter [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Registered counter for database nova_cell0 Oct 11 13:26:24.424641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_db.sqlalchemy.engines [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.429305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writer thread running {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.429933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writer thread running {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.439783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO dbcounter [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Registered counter for database nova_cell0 Oct 11 13:26:24.447038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_db.sqlalchemy.engines [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118881) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 13:26:24.452094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writer thread running {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 13:26:24.740950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: WARNING keystonemiddleware.auth_token [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:26:24.748372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: WARNING keystonemiddleware.auth_token [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:26:24.763846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: WARNING keystonemiddleware.auth_token [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:26:24.771487 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: WARNING keystonemiddleware.auth_token [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:26:25.103772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: WARNING keystonemiddleware.auth_token [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:26:25.110591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: WARNING keystonemiddleware.auth_token [None req-a2e0836b-9e12-4ffe-9734-d941dd4067bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:26:25.116093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: WARNING keystonemiddleware.auth_token [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 13:26:25.117261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650e801f9c0 pid: 118880 (default app) Oct 11 13:26:25.122300 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: WARNING keystonemiddleware.auth_token [None req-d525f08e-85a2-401c-8c1c-4ab99e3e1ebf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 13:26:25.127644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650e801f9c0 pid: 118881 (default app) Oct 11 13:27:05.930738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f535bcdd-8d39-48d8-af59-c52f161f2a16 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a560ad0d0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:05.973622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:05.975223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:05.976253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:05.977235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:06.511398 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f535bcdd-8d39-48d8-af59-c52f161f2a16 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9202e0e0-ce59-4931-b742-8682bd95568d" status: 200 len: 351 microversion: 2.1 time: 0.958702 Oct 11 13:27:06.520722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 1/1] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:27:05 2022] GET /compute/v2.1/os-volumes/9202e0e0-ce59-4931-b742-8682bd95568d => generated 351 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:08.341499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:08.342884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:08.343896 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:08.345172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:08.763142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-09fcd507-e95a-464f-a328-d17a7ba73a68 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a560681f0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:09.191874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-09fcd507-e95a-464f-a328-d17a7ba73a68 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/1283df34-e968-4d38-b2f0-e5e0262e95a3" status: 200 len: 351 microversion: 2.1 time: 0.856211 Oct 11 13:27:09.192777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:27:08 2022] GET /compute/v2.1/os-volumes/1283df34-e968-4d38-b2f0-e5e0262e95a3 => generated 351 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:10.909041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-838ff3a9-3838-44b8-a1be-d77b5655f262 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: .version_select at 0x7f7a55edf3a0>, body: {"keypair": {"name": "tempest-keypair-1683303466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlKVjYPzLtS1/TPConZrcMp+xHVuBpO1Czruw1u1ueeB3CFuZTzITayHB6iIfemQVu7paqA9p3LTpKcA/ENQ/mF6hiook/j0+Sx31vHYgH/YJwLV/Cxasv7pyNPJjo1dA=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:10.985567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-838ff3a9-3838-44b8-a1be-d77b5655f262 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:10.997841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-838ff3a9-3838-44b8-a1be-d77b5655f262 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for user d439d54a4f2348d78ddb84691f2a4f63 and project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:11.093086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-838ff3a9-3838-44b8-a1be-d77b5655f262 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.276993 Oct 11 13:27:11.093702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 2/3] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Oct 11 13:27:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 279 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:27:12.660738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6aabbf5a-98da-418e-987b-3e0f148e9049 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: .version_select at 0x7f7a55f2f1f0>, body: {"keypair": {"name": "tempest-keypair-1203257421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgksi8Tz4WDwiik55MpuI3EWc1KybBw5bnhFvodu7dqNNKkME5CIz6nbD0H5Fdp3Po7D/PPQ/tccgNPP5yAVmb382Vp/UEm8t8qeL0N7QyAIuKJ6Ilmu6uYTNyh9J7s+w=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:12.782098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-6aabbf5a-98da-418e-987b-3e0f148e9049 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:12.792368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-6aabbf5a-98da-418e-987b-3e0f148e9049 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:12.904600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6aabbf5a-98da-418e-987b-3e0f148e9049 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.371457 Oct 11 13:27:12.916528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 2/4] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:27:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:14.032554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1721323967", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ecd09a7-8518-4f60-ba4d-fd1b9214e176"}], "security_groups": [{"name": "tempest-securitygroup--376188688"}], "key_name": "tempest-keypair-1683303466", "user_data": "}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:14.769967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] validate_networks() for [('3ecd09a7-8518-4f60-ba4d-fd1b9214e176', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:17.331676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:17.338107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:17.340292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:17.341071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:17.342323 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:17.370128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:17.374773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:17.375789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:17.377229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:17.377984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:17.378671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:17.445457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:17.457383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for user d439d54a4f2348d78ddb84691f2a4f63 and project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:17.484479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:17.489348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:17.658202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-da4dd43d-aa56-416f-8bde-c9732e62cd10 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.633166 Oct 11 13:27:17.662783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 3/5] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Oct 11 13:27:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 13:27:17.676213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:17.677213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:17.859699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1852808196", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "networks": [{"uuid": "43155dfc-c5f7-465a-b223-96b1d6b2c5db"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:17.887631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:17.944311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] validate_networks() for [('43155dfc-c5f7-465a-b223-96b1d6b2c5db', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:17.947308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:17.957836 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:17.964654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6e1d712f-b428-4ced-9208-a21f44f750d6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1282 microversion: 2.20 time: 0.291270 Oct 11 13:27:17.967410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 3/6] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:17 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1282 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:18.754659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-58063ca7-d8c8-4aa3-9a44-ef02773122a9 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55e3c160>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:18.911568 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-58063ca7-d8c8-4aa3-9a44-ef02773122a9 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/c30b69a0-3ae2-4c16-a911-4d55b5d8bfe5" status: 200 len: 351 microversion: 2.1 time: 0.161361 Oct 11 13:27:18.912669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:27:18 2022] GET /compute/v2.1/os-volumes/c30b69a0-3ae2-4c16-a911-4d55b5d8bfe5 => generated 351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:18.927734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f6724519-a5ae-457b-afba-f97fe07ed5af tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55e3c8b0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:19.225593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f6724519-a5ae-457b-afba-f97fe07ed5af tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.303483 Oct 11 13:27:19.226714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Oct 11 13:27:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:19.233353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:19.235475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:19.555023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:19.563777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:19.569393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:19.575287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-77d1e305-5a35-488e-8441-104cdb3c8058 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1282 microversion: 2.20 time: 0.347041 Oct 11 13:27:19.576778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 6/9] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:19 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1282 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:19.589255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ca40406e-803a-4111-b05e-01adca1d1436 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55e3c430>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:19.802598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ca40406e-803a-4111-b05e-01adca1d1436 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.223428 Oct 11 13:27:19.803233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 7/10] 10.222.0.15 () {58 vars in 1149 bytes} [Tue Oct 11 13:27:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:19.824110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0a9d34a2-d12c-4384-9bb3-7da06fa6209d tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55dc70d0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:20.278683 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0a9d34a2-d12c-4384-9bb3-7da06fa6209d tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.464332 Oct 11 13:27:20.287832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 8/11] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Oct 11 13:27:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:20.293032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e149ac61-431b-40ce-a82d-9b59a751f56c tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55e3c310>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:20.570954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e149ac61-431b-40ce-a82d-9b59a751f56c tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.280493 Oct 11 13:27:20.570954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 9/12] 10.222.0.15 () {58 vars in 1167 bytes} [Tue Oct 11 13:27:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:20.656965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ed74e8d1-b553-4884-bc50-853118b06e5c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: .version_select at 0x7f7a55de6040>, body: {"keypair": {"name": "tempest-keypair-20210850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWtJTjIf7tpX4Il1iThiSVBHojGtM14C25+lR3bZ1V5QEHPGIkCmu5kpYbLGMsvmDeG5nfgOepq89nNidlYJ2zXT8ObpEcr95eQyj49OZwks12xaAK/gNDwIdKYiF/k4A=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:20.697743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-ed74e8d1-b553-4884-bc50-853118b06e5c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:20.715806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:20.716392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:20.716908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:20.717682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:20.718108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:20.735108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-ed74e8d1-b553-4884-bc50-853118b06e5c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for user 9a4a84c1ffc4466687122a6c67536d9b and project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:20.748614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:20.749110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:20.749553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:20.754397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:20.754898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:20.755337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:20.791973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ed74e8d1-b553-4884-bc50-853118b06e5c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.207553 Oct 11 13:27:20.792655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 10/13] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:27:20 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:20.795088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Getting quotas for project 2adf8ac988764dc29c6f0442b2398124. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:20.799906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Getting quotas for user e4e126b005e149258013ce3b6cf15524 and project 2adf8ac988764dc29c6f0442b2398124. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:20.805724 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1358857225", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9ecb25f-434f-42aa-a99d-d1d2a47d24ff"}], "security_groups": [{"name": "tempest-securitygroup--569339410"}], "key_name": "tempest-keypair-1203257421", "user_data": "}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:20.871611 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:20.878223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:21.004921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0aea718b-abdf-4d1b-82c4-0147660b71f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.246470 Oct 11 13:27:21.006155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 4/14] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:27:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:27:21.013574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a33b7d4b-abdc-4b34-86ea-209921913931 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55550dc0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:21.190272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a33b7d4b-abdc-4b34-86ea-209921913931 tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.181736 Oct 11 13:27:21.199981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 5/15] 10.222.0.15 () {58 vars in 1170 bytes} [Tue Oct 11 13:27:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:21.199981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:21.199981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:21.223203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:21.231912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:21.233057 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:21.233986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:21.234522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:21.235021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:21.312914 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] validate_networks() for [('f9ecb25f-434f-42aa-a99d-d1d2a47d24ff', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:21.827164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:21.876237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:21.877980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:21.880004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-53f1d5c9-1c8c-4cbd-afea-50dffb1be7ea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1342 microversion: 2.20 time: 0.687289 Oct 11 13:27:21.881208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 6/16] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:21 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1342 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:21.887133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f5a7c3b0-00b7-4f3c-b62f-1b3a556d84f8 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:21.887931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f5a7c3b0-00b7-4f3c-b62f-1b3a556d84f8 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:22.198419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f5a7c3b0-00b7-4f3c-b62f-1b3a556d84f8 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:22.222600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f5a7c3b0-00b7-4f3c-b62f-1b3a556d84f8 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1215 microversion: 2.1 time: 0.339701 Oct 11 13:27:22.236625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 7/17] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:21 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:22.243497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1b50776b-d8f9-4eca-acdb-84b9dad3affb tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55500940>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:22.529372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1b50776b-d8f9-4eca-acdb-84b9dad3affb tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.301185 Oct 11 13:27:22.530214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 8/18] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Oct 11 13:27:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:22.546102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-12f750ec-3417-4334-a570-3b94f06e66ad tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55496ca0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:22.808605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-12f750ec-3417-4334-a570-3b94f06e66ad tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.268795 Oct 11 13:27:22.809173 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1188 bytes} [Tue Oct 11 13:27:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:27:23.012531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-740141550", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:23.132949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] validate_networks() for [('1851f7f9-eb71-4d60-a92c-6fbf1b3da357', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:24.286174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:24.286820 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:24.287149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:24.287605 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:24.288062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:24.337640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:24.338453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:24.340085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:24.345401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:24.346213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:24.348697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:24.515151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:24.541435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:24.614651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:24.623751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:24.779340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9058415f-d785-4360-8101-76da1dfe8991 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.985450 Oct 11 13:27:24.785356 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:27:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:27:24.797797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dfe7781f-ef46-433f-9ef7-20581ef1804e tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] Calling method '.version_select at 0x7f7a55df2dc0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:25.141682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dfe7781f-ef46-433f-9ef7-20581ef1804e tempest-VolumesTestJSON-811880357 tempest-VolumesTestJSON-811880357-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.354812 Oct 11 13:27:25.142860 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 12/21] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Oct 11 13:27:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:25.159859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:25.160685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:25.182986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:25.188558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:25.190669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:25.191690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:25.195639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:25.196514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:26.453436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:26.499787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:26.508281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:26.509751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-07ca9725-3b71-4823-b996-128720d316eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 1.365693 Oct 11 13:27:26.516045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 13/22] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:25 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:26.528809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:26.532471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:26.541958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:26.545346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:26.546129 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:26.549012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:26.552249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:26.552992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:26.945984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:26.948682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:26.951200 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:26.951938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:26.952695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:26.965751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:26.967632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:26.970141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:26.973874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:26.976454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:26.978768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:27.043202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:27.055613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for user b50f86c6209f4a728cf3681a7d0a6765 and project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:27.080237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:27.089619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:27.090207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5779383a-5b22-49ab-a7ae-adb38d0e3652 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.572695 Oct 11 13:27:27.093214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 14/23] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:26 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:27.098728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1845661630", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13ee43d0-bd80-49dd-bae0-79ed5fdf057b"}], "security_groups": [{"name": "tempest-securitygroup--1350441257"}], "key_name": "tempest-keypair-20210850", "user_data": "}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:27.115785 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:27.288614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cd7215ec-a6fb-43a5-8dbe-e9edfca49c63 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.475647 Oct 11 13:27:27.289636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 10/24] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:27:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:27:27.313391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:27.315988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:27.341277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:27.344539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:27.347296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:27.350112 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:27.350805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:27.356476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:28.503119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:28.526161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0d1a7467-6b6a-4cd8-bd48-61b6a4382a4c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1294 microversion: 2.1 time: 1.229708 Oct 11 13:27:28.528312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 11/25] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:27 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1294 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:28.533265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a3bec07f-24dd-4074-9b34-c21a53c73f99 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:28.542209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a3bec07f-24dd-4074-9b34-c21a53c73f99 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:28.650496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] validate_networks() for [('13ee43d0-bd80-49dd-bae0-79ed5fdf057b', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:28.712075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a3bec07f-24dd-4074-9b34-c21a53c73f99 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:28.722168 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a3bec07f-24dd-4074-9b34-c21a53c73f99 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1221 microversion: 2.1 time: 0.192401 Oct 11 13:27:28.723385 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:28 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:28.748430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:28.749602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:28.769786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:28.775145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:28.778450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:28.779429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:28.783524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:28.785458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:30.283642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:30.306715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:30.315737 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:30.316942 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bfc8fc93-5fe7-4eb1-9817-d826e39ba723 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 1.589782 Oct 11 13:27:30.344388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 13/27] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:28 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:30.369381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:30.375623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:30.408446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:30.408950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:30.412443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:30.425457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:30.428085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:30.430052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:31.413312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:31.427884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3c92ec61-df9e-4a71-9e6b-4b2e96ee7099 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 1.082254 Oct 11 13:27:31.430063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 14/28] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:30 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:31.444927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1633241674", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:31.655582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] validate_networks() for [('1851f7f9-eb71-4d60-a92c-6fbf1b3da357', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:27:32.768443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:32.770052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:32.770674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:32.771242 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:32.771839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:32.790901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:32.791560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:32.792160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:32.793049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:32.793667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:32.795210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:32.836196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:32.844059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for user 9a4a84c1ffc4466687122a6c67536d9b and project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:32.871802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:32.881328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:32.962368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:27:32.962368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:27:32.962368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:27:32.962368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:27:32.964649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:27:33.009553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.018717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.020208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:33.029119 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-993d8ed3-781c-4712-86a8-29d7cc585a30 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.932006 Oct 11 13:27:33.031783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 15/29] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 5938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:27:33.041180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:33.046744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:33.059954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.067125 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.072341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:33.086939 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.087482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.087930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:33.088906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.091733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.095432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:33.181894 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:27:33.203395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for user b50f86c6209f4a728cf3681a7d0a6765 and project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:27:33.246492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:27:33.254228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:27:33.443109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b8684c07-24cc-4472-b407-128747dc45f1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.010405 Oct 11 13:27:33.452236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 15/30] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:27:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:27:33.497976 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:33.502154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:33.545258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.546912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.547772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:33.562465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:33.563573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:33.565219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.277302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:34.290386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f6cf343a-4b07-4200-90b4-8681b917ae6c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1300 microversion: 2.1 time: 1.255331 Oct 11 13:27:34.291110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:33 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1300 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:34.432993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea082e03-8b96-4006-82c8-1e376306d3e7", "tag": "1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:34.477386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:34.478361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:34.480771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.562646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Creating event network-changed:1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb for instance ea082e03-8b96-4006-82c8-1e376306d3e7 on hv-cinder-85061 Oct 11 13:27:34.563652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118881) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:27:34.565079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d217265d-5ba5-4cc9-899f-34c706b2fd7c req-431a987a-6bf0-4a9d-bf2d-01acb58252c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118881) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:27:34.567748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:34.569578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:34.570055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.573573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:34.574369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:34.576095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.599986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.compute.rpcapi [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 13:27:34.601386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] Releasing lock "compute-rpcapi-router" {{(pid=118881) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:27:34.632142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4798dc9f-3e9e-4264-bd31-37b164af3960 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339690 Oct 11 13:27:34.632821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:34.651834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:34.655259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:34.672388 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:34.674996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:34.675649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.678963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:34.681254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:34.681892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:34.818958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:34.837129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:34.838725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:34.847797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dbf4010a-d971-483b-8d88-19bcbad48442 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 1.386719 Oct 11 13:27:34.849048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:33 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:35.565006 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:35.607893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:35.609179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:35.611630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:35.683488 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Creating event network-changed:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:27:35.684146 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118880) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 13:27:35.684925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91808875-9715-4b91-8cfa-47aad584c9fb req-e8d7e943-9b8a-4cf4-9eb4-9997c04918cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=118880) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 13:27:35.690540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:35.691062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:35.691941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:35.695297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:35.696362 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:35.696854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:35.725677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.compute.rpcapi [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 13:27:35.731547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] Releasing lock "compute-rpcapi-router" {{(pid=118880) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 13:27:35.760840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-96f1beb5-bc35-4d01-853b-2dda1bdb0387 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.910210 Oct 11 13:27:35.761954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 17/34] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:35.788454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:35.789550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:35.814103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:35.826289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:35.830465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:35.833186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:35.834657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:35.837732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:35.838463 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:36.680612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:36.696341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2e53ae17-163a-4d2e-84d4-6e0c2eed402d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1288 microversion: 2.1 time: 0.922119 Oct 11 13:27:36.699478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 18/35] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:35 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1288 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:36.712690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:36.719074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:36.723169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:36.731790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ce892ddb-1f6f-42c1-b5d5-a871114305fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 2.085576 Oct 11 13:27:36.735564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:34 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:36.737741 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:36.738235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:36.738671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:36.744450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:36.745189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:36.745633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:36.747281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:36.753925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:36.791389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:36.805551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:36.818865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:36.821581 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:36.822628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:36.824613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:37.070321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:37.088798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2b182aab-19c8-4a48-b3e6-3815fe13ca41 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1274 microversion: 2.1 time: 0.382590 Oct 11 13:27:37.105078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 19/37] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:36 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:37.110634 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:37.111559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:37.118000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:37.118873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:37.119514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:37.120544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:37.121525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:37.122144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.245214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.266151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-83362960-f7cc-4832-8ca1-2e61ca16984f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 1.526525 Oct 11 13:27:38.271050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:36 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:38.288282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d119505-75d4-4f57-8292-83839956f749", "tag": "f1a0db70-a61c-43e6-8700-e593abe74b8d"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:38.314469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.315172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.316474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.350608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] Creating event network-changed:f1a0db70-a61c-43e6-8700-e593abe74b8d for instance 7d119505-75d4-4f57-8292-83839956f749 on hv-cinder-85061 Oct 11 13:27:38.373852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-fa9225aa-02b2-4364-b48f-9a65872e8875 req-669e9ab0-3bbe-4617-82bc-ce0ac74026e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099142 Oct 11 13:27:38.376421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 20/39] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:38.391370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:38.395507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:38.413894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.414713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.417866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.419988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.425042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.426776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.434844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.452254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.455732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.458382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-15331cc3-6b56-4c7c-b41c-4d67bd907238 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 1.352049 Oct 11 13:27:38.465476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 20/40] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:37 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:38.476048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:38.489474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:38.507503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.512708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.513667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.514596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.515239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.515836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.764151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.781441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8dce93ea-9a32-43d7-b328-60140921639d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.400750 Oct 11 13:27:38.798846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:38 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:38.814087 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:38.814860 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:38.825071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.830058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.831214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.832159 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:38.833336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:38.836877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:38.956888 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:38.966023 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b73272b3-d8ce-4d8b-8f02-2b7474093b7c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.498842 Oct 11 13:27:38.966592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:38 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:39.009995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.022893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d38f7308-ba11-4f1d-9042-e5ad16567c2f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.219498 Oct 11 13:27:39.023784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:38 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:39.296197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:39.296837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:39.302759 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.303637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.304312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.305226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.305899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.306511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.456326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ec8e2f-5c8c-414b-acec-852608b2e0f2", "tag": "0831c3f5-2c69-4990-9a5e-7debdae49aaf"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:39.465008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:39.479526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.480260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.481404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.504398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] Creating event network-changed:0831c3f5-2c69-4990-9a5e-7debdae49aaf for instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 on hv-cinder-85061 Oct 11 13:27:39.517053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-6ab90de7-7684-46ae-89f2-96b162ff06fa req-ce0e3792-25a2-49da-b430-5338fd4970f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064211 Oct 11 13:27:39.518818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 23/44] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:39.526806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:39.528747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:39.535791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.544776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a1aa36dc-d8bc-4fee-bee5-c16b68a68b5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.253169 Oct 11 13:27:39.556157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:39 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:39.556557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.556557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.556557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.556557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.556817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.556817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.719348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.729022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.730737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.732167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-74037d87-1534-4aab-8d71-d697c1a941f4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.211132 Oct 11 13:27:39.732877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:39 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:39.809288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:39.809897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:39.816006 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.816521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.816959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.817654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.818111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.818542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.880437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:39.888427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-731a01f4-f2ee-4834-92ae-915f331180a1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.082908 Oct 11 13:27:39.889013 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:39 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:39.990949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:39.991560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:39.997833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.998321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:39.998753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:39.999459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:39.999908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.000354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.048606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:40.049225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:40.055978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.056589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.057051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.057798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.058265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.058681 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.137456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.145816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0012a7c0-2150-406e-935c-93895334738e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.101480 Oct 11 13:27:40.146393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:40 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:40.168831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.176633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a9ff99ec-e2db-436a-80ba-2d85e62c9091 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.189572 Oct 11 13:27:40.177184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:39 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:40.573284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:40.573927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:40.580366 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.580853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.581281 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.581966 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.582421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.582851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.713902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.724806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0391f436-e2b7-4131-8846-f2847ec8c71b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.157186 Oct 11 13:27:40.725404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:40 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:40.757010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:40.758040 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:40.765905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.766397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.766834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.767840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.768529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.768955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.910917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:40.911530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:40.912520 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.921524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.923102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:40.924355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b82969c6-d91b-42bf-84e9-3d26342a6fb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.171328 Oct 11 13:27:40.924702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.925423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 26/51] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:40 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:40.925698 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.926229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.927090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:40.927544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:40.927967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:40.993084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:41.002089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2593526f-c4f7-4ce4-ac07-877176a4ae56 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.095174 Oct 11 13:27:41.002666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:40 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:41.169896 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:41.170515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:41.177544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.178693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.179503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.180530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.181279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.181784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.200171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:41.201440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:41.208664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.209343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.210069 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.211080 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.211925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.212672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.233051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:41.258941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:41.266951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f8bf2e73-90fa-4b84-9795-92401ca8fa54 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.102190 Oct 11 13:27:41.267848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:41 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:41.357382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:41.368569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-527cdbf6-65b0-414d-8d7a-897d401baf8d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.172731 Oct 11 13:27:41.369379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 27/54] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:41 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:41.750008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:41.750886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:41.760170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.761037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.761619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.762674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.763369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.764024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.906350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:41.914254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0b081623-4c0d-4274-ba1b-2d5283bc5b14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.170482 Oct 11 13:27:41.914826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 28/55] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:41 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:41.949708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:41.950295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:41.956570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.957053 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.957506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:41.958190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:41.958641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:41.959141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.025719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:42.026239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:42.032344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.032827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.033270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.033945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.034392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.034814 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.105477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.114812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-553541aa-bb5a-49cb-b1c1-bec06f580f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.092980 Oct 11 13:27:42.115372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:42 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:42.123481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.132685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.134245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.135350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-abf8d4f6-d1ca-4362-a072-7a6c6e8aa2a4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.189588 Oct 11 13:27:42.135898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:41 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:42.290762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:42.291406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:42.297840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.298361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.298748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.299445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.299958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.300441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.365893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.373490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0c191109-1165-4859-b023-f26b992a2591 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.086867 Oct 11 13:27:42.374249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 30/58] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:42 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:42.397263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:42.397870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:42.404357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.404849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.405280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.405971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.406423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.406848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.548887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:42.558315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dba0f458-9d71-49d4-9623-ee5eca937526 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.164014 Oct 11 13:27:42.560414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:42 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:42.939934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:42.941173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:42.945075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=24 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:42.949327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.950233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.950956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.951958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:42.952782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:42.953489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:42.975130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:43.112598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.120452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b9df2311-db22-43ac-a316-5e135aeefafd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.185687 Oct 11 13:27:43.121019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 31/60] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:42 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:43.138389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:43.139667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:43.147998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.148716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.149566 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.150806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.151701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.152383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.160788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:43.161419 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:43.168273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.169086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.169670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.170648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.171097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.171663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.227673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.229923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=32 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:43.238739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-79d7d5c5-a054-42b0-8c2d-e37a49f58192 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.105116 Oct 11 13:27:43.245310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 30/61] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:43 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:43.346687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.356257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.358400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.360105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-585c13a8-e428-433d-9442-d12d4a8bf842 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.203155 Oct 11 13:27:43.361110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:43 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:27:43.396863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:43.397479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:43.403794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.404277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.404921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.405667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.406264 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.406871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.486872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.494936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-753e20fc-e3ab-4ed4-91fd-a38ab5424c2b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.102565 Oct 11 13:27:43.495522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:43 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:43.582359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:43.582918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:43.596948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.597437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.598013 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.598724 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:43.599195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:43.599623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:43.804496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:43.814691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3c40da3a-c8dc-4937-999e-83e0796a3950 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.236185 Oct 11 13:27:43.815406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:43 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:44.143520 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:44.144145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:44.158882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.159670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.160381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.161314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.162150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.164250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.262996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:44.263881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:44.274308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.276216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.276960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.279970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.280787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.282476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.593019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=6 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:44.634950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:44.648729 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-67e6369f-ae08-4175-8e5d-f5f788d56469 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1294 microversion: 2.1 time: 0.390643 Oct 11 13:27:44.660466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 34/65] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:44 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1294 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:44.671100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:44.672034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:44.679783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.680495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.681233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.682112 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.682764 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.683244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.849868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:44.865237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1d0ac940-7a22-419f-955e-c21b9d3dfd67 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.725234 Oct 11 13:27:44.884904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 32/66] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:44 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:44.898200 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:44.899000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:44.906324 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.907015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.907634 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:44.908731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:44.909325 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:44.909891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.013882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.022415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.023857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.027202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-04a2947f-3d65-4480-9f52-35c96f870647 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.365450 Oct 11 13:27:45.029312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 35/67] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:44 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:45.034103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:45.034880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:45.044432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.047145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.047773 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.048696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.049344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.049949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.068698 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.081129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-93bfb905-71c2-44a6-bd12-55d937a819a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1280 microversion: 2.1 time: 0.195105 Oct 11 13:27:45.096272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 33/68] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:44 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:45.310351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.320374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-51a39e6b-a8a0-49e1-a49e-d648c0168f28 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.289348 Oct 11 13:27:45.323407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:45 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:45.674513 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:45.675952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:45.682214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.682767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.683254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.684159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.685013 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.688286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.722655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=10 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:45.853835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:45.865795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-65d922b1-11fc-4084-95f9-27aca9eb7698 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.194983 Oct 11 13:27:45.866643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:45 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:45.891733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:45.892788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:45.899146 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.899681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.900298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:45.901170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:45.902023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:45.902397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.040951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.055339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3c07fba4-1722-4a29-91f1-5252aa13c2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.166719 Oct 11 13:27:46.056543 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 37/71] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:45 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:46.069799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:46.070549 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:46.079403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.080275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.080873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.081573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.082024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.082448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.109475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:46.110215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:46.117815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.118534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.119243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.120104 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.120743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.121437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.286623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.295224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.296991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.298622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-79f58cab-8872-4ef9-a433-248432698a0f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.244945 Oct 11 13:27:46.314463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.316302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 35/72] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:46 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:27:46.324935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-976e855c-375c-4988-8ad7-db0a8e4de20f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.219735 Oct 11 13:27:46.325617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 38/73] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:46 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:46.346948 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:46.347790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:46.355301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.355530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.356278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.357548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.358125 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.358628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.502481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:46.510538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-33524ebd-1f68-467c-b06a-ffebfe9946e7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.169107 Oct 11 13:27:46.511108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:46 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:46.891144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:46.891945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:46.898402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.898864 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.899292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:46.904966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:46.905403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:46.905838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.038085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.045870 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-61a940bf-9694-4e19-87da-8746fa78e7cc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.159931 Oct 11 13:27:47.046453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 39/75] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:46 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:47.082300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:47.082912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:47.089195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.089679 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.090113 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.090801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.091249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.091671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.221051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.228871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ce14846e-3ecc-4670-870c-17697e440472 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.150637 Oct 11 13:27:47.229445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 37/76] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:47 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:47.323697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:47.324365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:47.330539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.331028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.331468 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.332187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.332706 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.333107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.350455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:47.351507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:47.359087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.359963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.360580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.361538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.362284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.362979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.546387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.554197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f335a37d-33f1-44c1-9967-9b054f02f4c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.207898 Oct 11 13:27:47.554856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 38/77] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:47 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:47.559334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:47.559920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:47.562748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.566649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.567188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.567612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.568495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:47.569221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:47.569617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:47.572677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.574675 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.575869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b5587096-63a8-4d96-9b7f-d2d5e529b35a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.256399 Oct 11 13:27:47.576477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 40/78] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:47 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:47.706527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:47.714497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3d5c915b-b85d-4bc7-8f9b-18b4801f5d20 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.158702 Oct 11 13:27:47.715072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 39/79] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:47 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:48.069703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:48.070924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:48.077749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.078249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.078865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.079750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.080451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.081188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.235173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:48.242894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1a4d0a94-d566-4cb1-bd0c-a66dbbcd464f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.177132 Oct 11 13:27:48.243471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 41/80] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:48 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:48.250885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:48.252006 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:48.259244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.259663 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.260097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.260808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.261253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.261945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.579767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:48.581324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:48.590247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.590969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.591577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.592488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.593178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.593739 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.847092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:48.863951 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-25ec81a4-2ef9-41d2-b46f-b3842e2d5c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.616709 Oct 11 13:27:48.864614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 40/81] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:48 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:48.871621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:48.872593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:48.878800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.879453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.880053 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.880766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.881366 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.881957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.932705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:48.941548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ea8ef1ed-28ab-4fa1-abb0-c0ab5cc45291 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.368247 Oct 11 13:27:48.942681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 42/82] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:48 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:48.949371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:48.949990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:48.961295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.961830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.962269 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:48.962970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:48.963417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:48.963837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.067690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:49.081962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:49.083392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:49.084519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bb65b628-aeb4-4318-b392-019e88e0679e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.217691 Oct 11 13:27:49.085845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 41/83] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:48 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:49.143226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:49.151654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0e73c74f-8951-4300-a3fd-57929fb78e35 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.207751 Oct 11 13:27:49.152233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:48 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:49.266519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:49.267121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:49.273470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.273955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.274472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.275344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.275786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.276532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.413339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:49.421405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7bcbc235-6598-4b9a-9555-816be1a3cfd6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.158599 Oct 11 13:27:49.422068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:49 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:49.555681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbf33db-3a51-4c5a-af47-00e632d2cbb9", "tag": "ff1917f6-b480-42fc-aa3c-be06bebf4ac3"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:49.565907 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.566451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.566882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.594058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] Creating event network-changed:ff1917f6-b480-42fc-aa3c-be06bebf4ac3 for instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 on hv-cinder-85061 Oct 11 13:27:49.599321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-8bf8f130-6f01-446b-bfe3-37a9075b5931 req-de7acbce-e703-439f-a409-ad1d7e44074f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047406 Oct 11 13:27:49.600251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 44/86] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:27:49.886811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:49.887692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:49.893987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.894471 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.894907 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.895598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.896172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.896491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.967747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:49.968636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:49.975906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.976421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.976994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:49.977900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:49.978464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:49.978938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.069979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.078752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f9182ba5-8dd8-4e4e-9164-bfcefef9ac9d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.195691 Oct 11 13:27:50.079913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 43/87] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:49 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:50.109313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:50.109938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:50.116203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.116646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.117077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.117772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.118459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.119078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.124423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:50.149655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.158465 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e488a2ea-299c-4dd8-a0e3-693d587a3c20 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.198164 Oct 11 13:27:50.159030 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 45/88] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:49 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:50.175016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:50.175734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:50.182195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.182771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.183275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.184369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.184898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.185436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.315121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.323487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.324950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.326051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6a273999-c34a-4bdf-b4c3-745a329826ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.220659 Oct 11 13:27:50.326599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 44/89] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:50 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:50.342581 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.350603 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-26ac24b1-7ea0-49cf-81e4-91c5aca5c88c tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.179832 Oct 11 13:27:50.351227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:50 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:50.446668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:50.447284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:50.453607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.454095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.454630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.455323 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:50.455781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:50.456244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:50.583636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:50.591446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-44f2b452-3fa7-4f5c-9e1d-e0692f2d0e9e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.151010 Oct 11 13:27:50.591990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 45/91] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:50 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:51.102918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:51.103730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:51.109855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.110332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.110760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.111440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.111885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.112345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.196873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:51.198538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:51.206527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.207212 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.207787 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.208657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.209109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.209517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.293275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.304720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7a91f5fa-2584-4ca1-ab71-d57b5a1c9312 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.205673 Oct 11 13:27:51.306002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:51 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:51.351035 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:51.351883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:51.360926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.361512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.362027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.362949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.363787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.364498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.369291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.377739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-81d41530-4f0a-4d31-b44d-d78b0779b7b1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.184603 Oct 11 13:27:51.378683 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 46/93] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:51 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:51.384406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:51.385213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:51.394132 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.394618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.395050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.395744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.396227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.396626 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.563348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.567765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:51.573592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.575162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.576762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b796ae10-a9d7-4aec-a4a6-71ee677b2741 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.229503 Oct 11 13:27:51.592764 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 48/94] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:51 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:51.596051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.614613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3c1125ed-ac53-4d23-a0df-8baaa3e071f1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.234205 Oct 11 13:27:51.615478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 47/95] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:51 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:51.619661 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:51.624595 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a", "tag": "40098450-36a3-4009-9731-eb6463cc6f92"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:51.625483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:51.640331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.641156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.641794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.642988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.643623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.644073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:51.644517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.644630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:51.645081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:51.656677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] Creating event network-changed:40098450-36a3-4009-9731-eb6463cc6f92 for instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a on hv-cinder-85061 Oct 11 13:27:51.665748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-2f7fb1dd-81d0-4b1b-9e81-dfd8bd87dc3c req-25473839-6f22-4f64-8732-24cda7e95611 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044527 Oct 11 13:27:51.666707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 48/96] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:51.794981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:51.802702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bbcbf187-c1c3-4687-bd75-ac4f5adbed42 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.192229 Oct 11 13:27:51.804160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 49/97] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:51 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:52.327473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:52.328203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:52.334522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.335000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.335423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.336166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.336599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.337094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.401056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:52.401653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:52.408010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.408597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.409060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.409748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.410345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.410945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.517946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.526528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4b9cb520-3da2-4053-967e-e1d6d0c90315 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.203305 Oct 11 13:27:52.527397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 49/98] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:52 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:52.563186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.570961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4d462013-c1d9-4fa7-a161-cae5b188e9a4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.174077 Oct 11 13:27:52.571597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:52 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:52.603099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:52.603700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:52.610199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.610673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.611097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.611769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.612245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.612676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.637942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:52.638582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:52.644978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.645464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.645895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.646587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.647037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.647457 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.798329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.806578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.808014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.809138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8c5b4ea3-2577-4f47-866e-8ffc7ba95839 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.210035 Oct 11 13:27:52.809760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 50/100] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:52 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:52.821481 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.825514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:52.826148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:52.830221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f4ad4593-4331-4ca1-96d6-d4ca6032b0cc tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.196038 Oct 11 13:27:52.830788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:52 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:52.831978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.832481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.832919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.833601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:52.834067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:52.834484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:52.972628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:52.980775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-189688c7-42e3-472f-840a-650c4c27b694 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.158859 Oct 11 13:27:52.981556 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 51/102] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:52 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:53.549285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:53.549852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:53.555983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.556844 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.557311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.557994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.558441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.558887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.593968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:53.595306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:53.602283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.603141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.603908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.605074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.605861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.606583 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.755399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:53.764066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-58225690-04fe-43d8-9b77-9b77407893b2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.218666 Oct 11 13:27:53.764671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 52/103] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:53 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:53.793704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:53.802493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-80d217e6-4a27-4fb0-abe7-2cb8084cccfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.212288 Oct 11 13:27:53.802793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 52/104] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:53 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:53.833855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:53.834549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:53.840706 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.841402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.841832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.842676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.843127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.843545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.852864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:53.853631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:53.859773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.861092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.861527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:53.862285 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:53.862736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:53.863343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.159425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:54.161602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:54.167834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:54.169499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:54.170668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7d9e40cc-eb8b-4bab-ab8e-6fc5d0821eb9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.340741 Oct 11 13:27:54.171260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 53/105] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:53 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:27:54.175483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:54.176078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:54.181920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.182391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.182817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.183498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.183942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.184383 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.187937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cf78d561-3c41-454d-9533-11aca0110841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.339112 Oct 11 13:27:54.190786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:53 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:27:54.360466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:54.369334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a59bc228-739a-4d87-835a-27fb5c7d269e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.197000 Oct 11 13:27:54.369922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 54/107] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:54 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:54.788327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:54.788922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:54.796481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.796961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.797397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.798084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.798530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.798943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.828493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:54.829033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:54.835356 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.835848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.836430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:54.837163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:54.837615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:54.838031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.074322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.082990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3851c0c9-320e-4986-a92b-e725138d3239 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.299561 Oct 11 13:27:55.083494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 54/108] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:54 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:55.091010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.101713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5a58a26e-07fd-4593-bbda-45ec86af124c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.280075 Oct 11 13:27:55.102674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 55/109] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:54 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:55.210759 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:55.211777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:55.217252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:55.217970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:55.218213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.218869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.219301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.219991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.220610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.221175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.224489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.225069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.225593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.226384 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.227019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.227561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.421754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.424747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.432493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ce0d8bcb-09d9-4e95-928e-965ab3d5cfee tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.219126 Oct 11 13:27:55.433062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:55 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:55.433263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.437717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:55.438310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:55.439883 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.441450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-90c7d229-e390-4b81-a854-128852c5975d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.234555 Oct 11 13:27:55.442547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 55/111] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:55 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:55.443975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.444488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.444914 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.445591 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:55.446043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:55.446478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:55.576873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:55.585556 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-763cdfa7-16f8-4416-8708-7f6e6c7e74da tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.151178 Oct 11 13:27:55.586054 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 57/112] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:55 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:56.108555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:56.109899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:56.120550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.126205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:56.127400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:56.140881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.141611 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.142216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.143074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.144289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.149550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.150775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.151246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.151822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.152581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.153705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.919265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:56.929295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:56.930846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fc0f8ece-4df1-4473-81b2-2ee4a12d2c2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.826246 Oct 11 13:27:56.931779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 56/113] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:56 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:56.936590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:56.937058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-687fc8ab-957d-4781-b205-fcbff17af6bd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.814981 Oct 11 13:27:56.937526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:56.937649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 58/114] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:56 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:56.941966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:56.942552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:56.956145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.956332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.956332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.956519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.956606 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.956689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.956771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.956771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.956926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:56.957009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:56.957106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:56.957106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.148998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:57.154672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:57.156771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7e928a28-40c7-47a6-93a1-b2aa2a98a71f tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.223775 Oct 11 13:27:57.157343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:56 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:57.162052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:57.162657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:57.165017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:57.166477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:57.167582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d90afffc-9f68-48fc-8860-841f99a54f5c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.229105 Oct 11 13:27:57.168155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 59/116] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:56 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:57.168521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.168994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.169581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.170426 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.170878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.171299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.264861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "name": "network-vif-plugged", "status": "completed", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:27:57.280906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.281485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.281968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.295199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] Creating event network-vif-plugged:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:27:57.303960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-5db39712-04a7-415d-a245-df7d0443079e req-b9c39354-0aed-434f-8cf7-2e30fbb6f33e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134367 Oct 11 13:27:57.304729 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 60/117] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:27:57.363840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:57.371843 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5780cc53-b932-4f1c-bc5e-1f1593f3211b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.213322 Oct 11 13:27:57.372468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 58/118] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:57 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:57.959609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:57.960792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:57.971153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.971774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:57.972025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.972695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.972910 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:57.973828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.974577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.975281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.980892 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.981375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.981807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:57.982500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:57.982956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:57.983379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.166586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.169977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.174742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-627b7b59-6b53-421c-9a45-b23dfdec838e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.222240 Oct 11 13:27:58.175462 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 61/119] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:57 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:58.178432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7c56afd7-3fdd-49b8-85b3-7516ddca433c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.212878 Oct 11 13:27:58.179270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 59/120] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:57 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:58.180206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:58.181076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:58.187254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.187842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.188424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.189229 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.189783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.190279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.196858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:58.197677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:58.203770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.204254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.204689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.205387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.205833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.206245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.383679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.386980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.392063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9eba76f1-89f6-4800-ad14-7f20f4666d11 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.215627 Oct 11 13:27:58.393009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 62/121] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:58 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:58.397993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.397993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.398151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:58.398151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:58.398432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c7f76668-2100-4b54-868f-fe17f51a8cf3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.205293 Oct 11 13:27:58.399152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 60/122] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:58 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:27:58.405298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.405298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.405298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.405644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:58.406097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:58.406513 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:58.536834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:58.545121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ca54fa1c-3917-42d7-aa1a-d8fce004a4fd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.151073 Oct 11 13:27:58.545635 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 63/123] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:58 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:59.201560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:59.202548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:59.204723 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:59.205716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:59.212669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.213148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.213575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.214207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.214365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.214688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.214818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.215104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.215249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.215776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.216220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.216648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.233256 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:27:59.406775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.409577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.415156 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-68917fae-1599-4ead-ba4e-c9359ec653cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.219990 Oct 11 13:27:59.415750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 61/124] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:59 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:59.417498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4953954a-62f8-418a-87d9-8cf7be93b30e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.219061 Oct 11 13:27:59.417999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 64/125] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:59 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:59.420224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:59.420820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:59.426805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.427414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.427965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.428808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.429376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.430011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.430147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:59.430776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:59.436745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.437266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.437701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.438393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.438882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.439305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.622545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.625862 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.631410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5c946787-fd6d-44a2-ad88-7c4c9a50caea tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.214640 Oct 11 13:27:59.632021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 62/126] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:59 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:27:59.635062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.636516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.636740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:27:59.637131 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:27:59.637610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3b1a7408-6425-456e-9b51-f3ad64db3415 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.211175 Oct 11 13:27:59.638131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 65/127] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:27:59 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:27:59.643601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.644085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.644545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.645231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:27:59.645677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:27:59.646097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:27:59.771451 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:27:59.779370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7bfd5af3-95ea-4e1e-a5c3-30ab5bfa712e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.146392 Oct 11 13:27:59.779945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 63/128] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:27:59 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:00.438154 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:00.438607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:00.440722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:00.441384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:00.445044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.445189 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.445566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.446280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.446703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.447152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.447402 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.448000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.448378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.449126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.449499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.449917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.451537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:00.652532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.660152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.661693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-96ce0d7b-8df4-4007-8fd4-1c620610182d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.227571 Oct 11 13:28:00.662331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 66/129] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:00 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:00.668551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-aea7355d-7ed4-4749-bf01-cd1a02ed4ee2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.231496 Oct 11 13:28:00.669114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 64/130] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:00 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:00.673814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:00.674550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:00.681121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.681528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:00.681639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.682098 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.682245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:00.683046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.683633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.684241 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.688419 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.688905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.689309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.690004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.690450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.690872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.879614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.884547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.888888 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.890327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:00.891426 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-33930f22-bb9b-4ac5-9f00-b285e5e4baf4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.221258 Oct 11 13:28:00.892002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 65/131] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:00 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:28:00.892843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c55a9337-1789-4281-adfe-1aceec468e21 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.214693 Oct 11 13:28:00.893676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 67/132] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:00 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:00.896669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:00.897295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:00.903452 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.903775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.904281 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:00.904978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:00.905430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:00.905851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.041805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:01.049632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fe3b2a0a-f07e-4192-bd52-ee44a8311ab5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.156323 Oct 11 13:28:01.050189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 66/133] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:00 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:01.684561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:01.685217 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:01.693323 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.693988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.694842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.695542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:01.696613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:01.696887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.697627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.698188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.703845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.704636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.705138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.706274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.706831 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.707474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.926549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:01.933839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:01.943671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-692b45b6-7c01-4bf2-ba50-f28a0f4ff74e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.262737 Oct 11 13:28:01.943955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8cace0f7-3990-4156-8352-857636a07239 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.252843 Oct 11 13:28:01.944564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:01 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:01.952911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 68/134] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:01 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:01.957639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:01.961200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:01.968187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:01.968869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:01.975027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.975284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.975788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.976530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.976980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.977425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.994372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:01.996140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.996637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.997071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:01.997772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:01.998376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:01.998800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.197695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:02.206631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:02.208678 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:02.210288 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-615bfc50-04ba-43c3-a3ec-babe50e15813 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.256294 Oct 11 13:28:02.210873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 69/136] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:01 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:28:02.214602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:02.215372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:02.215987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:02.222125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.222602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.223044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.223729 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.224194 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.224610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.226488 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1388f9fb-5043-4eed-9f16-fee360c01751 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.272425 Oct 11 13:28:02.228151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 68/137] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:01 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:02.367766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:02.375674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e3e8b9a3-c56d-45d7-96e5-6612da3bd112 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.163801 Oct 11 13:28:02.376434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 70/138] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:02 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:02.968039 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:02.968637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:02.968985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:02.969236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:02.976693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.977530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.977975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.979231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.979231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.979713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.980669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.981742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.982401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:02.984101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:02.985157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:02.986645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.440014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.458441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.461552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4fefe27c-447f-4e82-8161-e3df8122f396 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.495605 Oct 11 13:28:03.470708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4eed7919-ed21-47d4-9cc7-dc7f0752424e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.507594 Oct 11 13:28:03.471434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:02 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:03.483115 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:03.486344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:03.496273 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 69/140] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:02 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:03.498959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.500191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.501198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.503538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.504526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.506126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.524252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:03.526523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:03.552497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.556575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.558825 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.561749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.563902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.564541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.913463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.926597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.928049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.929243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ff55b1d0-c95a-4e2f-b26b-a4e00903a5a1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.456722 Oct 11 13:28:03.929801 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 72/141] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:03 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:28:03.944568 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d119505-75d4-4f57-8292-83839956f749", "name": "network-vif-plugged", "status": "completed", "tag": "f1a0db70-a61c-43e6-8700-e593abe74b8d"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:03.949406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:03.952830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.953365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.954023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.954751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:03.965257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a51d7b47-d139-4f9f-85c9-3ba3a84c5534 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.466775 Oct 11 13:28:03.966311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 70/142] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:03 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:03.967498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] Creating event network-vif-plugged:f1a0db70-a61c-43e6-8700-e593abe74b8d for instance 7d119505-75d4-4f57-8292-83839956f749 on hv-cinder-85061 Oct 11 13:28:03.972453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-e1510db1-714d-4d9d-a806-cd1ac6524cea req-1cfd63c9-02a3-43c7-ac49-cfae453cbafa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 Oct 11 13:28:03.973356 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 73/143] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:03.973649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:03.974291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:03.982205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.982755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.983631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:03.983899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:03.984345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:03.984768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.118623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:04.126371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9f9ed406-23ca-418b-beb2-9b9a23dd7cf8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.158631 Oct 11 13:28:04.127117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 71/144] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:03 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:04.502130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:04.502841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:04.503838 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:04.504486 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:04.510771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.511249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.511681 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.511888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.512391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.512501 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.512891 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.513014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.513265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.513496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.513950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.514368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.731225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:04.744630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:04.753911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e4cd7f15-e1ba-4ec1-807c-22fda1465491 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.255979 Oct 11 13:28:04.755522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 74/145] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:04 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:04.756347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c049094e-e61d-4932-945a-3abf058c7a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.256260 Oct 11 13:28:04.772153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 72/146] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:04 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:04.955844 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:04.956695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:04.967880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.971319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.971927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.975780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:04.976932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:04.977902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:04.988103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:04.989492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:05.001555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.002047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.002479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.003175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.009847 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.011126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.353864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:05.367658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a7cf966a-86f9-4e80-8861-f8496d365444 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.382292 Oct 11 13:28:05.369509 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 73/147] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:04 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:05.379937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:05.382311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:05.394398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:05.417196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:05.423332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:05.427259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.428280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.428280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.428972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.429475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.429995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.436617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9e67681f-46a2-4c96-b880-628e9db11e34 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.484870 Oct 11 13:28:05.437948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 75/148] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:04 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:28:05.609367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:05.620432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4dfa4169-0669-4496-a8f7-9370e697da4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.247743 Oct 11 13:28:05.621219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 74/149] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:05 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:05.779047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:05.779730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:05.785990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.786516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.786954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.787619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.788257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.788888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.792266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:05.793684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:05.800403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.800982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.801483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:05.803086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:05.803783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:05.804374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.019525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.022695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.028828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-20dfcf06-7075-43d6-97d8-d63b6caa8adb tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.241147 Oct 11 13:28:06.029441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:05 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:06.031879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-afb1498f-6d97-44a6-a0d4-0c91f46fbbf5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.256965 Oct 11 13:28:06.033032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:05 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:06.034164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea082e03-8b96-4006-82c8-1e376306d3e7", "name": "network-vif-plugged", "status": "completed", "tag": "1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:06.044547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.045333 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.045968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.057718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] Creating event network-vif-plugged:1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb for instance ea082e03-8b96-4006-82c8-1e376306d3e7 on hv-cinder-85061 Oct 11 13:28:06.063056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-18e51d81-4606-414c-a000-988c59b4605b req-8e917b6f-3cfe-4623-a4c2-45065924ba18 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Oct 11 13:28:06.063609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 76/152] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:06.394025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:06.395554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:06.407560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.408492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.409794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.410643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.411427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.412283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.466691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:06.467732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:06.475665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.476415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.476872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.477853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.478497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.479121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.637277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.647284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-31069e20-8573-41e0-9bcd-0538f60476eb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.258221 Oct 11 13:28:06.648151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 77/153] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:06 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:06.652913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:06.653742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:06.659784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.660584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.661191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.662082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:06.662704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:06.663292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:06.711642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.729298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.731206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.732505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0babf6ed-bdcb-4c97-966e-96610699b613 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.271304 Oct 11 13:28:06.733140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 77/154] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:06 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:28:06.833227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:06.844169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e1f2b910-5d4f-463e-9dcb-6b9c0653453b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.194722 Oct 11 13:28:06.844942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 78/155] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:06 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:07.060332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:07.061077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:07.061582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:07.062261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:07.076446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.077187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.078285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.078493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.080171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.080919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.081391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.082037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.082669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.085470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.087530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.088286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.311224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:07.320699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-24999e5b-5045-414b-b32f-d37f0de88924 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.269406 Oct 11 13:28:07.321395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 79/156] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:07 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:07.323479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:07.327457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:07.333382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-31cf64af-d385-42fe-b947-ac4bbecf1046 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.283711 Oct 11 13:28:07.334142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:07 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:07.670650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:07.671215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:07.678140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.678916 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.679531 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.680539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.681235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.681847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.759990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:07.760638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:07.767082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.767875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.768542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.769238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.769692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.770108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.957471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:07.967746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1fb8f683-15fb-48da-848c-d2cd26093aae tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.300782 Oct 11 13:28:07.970140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:07 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:07.984242 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:07.985197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:07.992788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.993506 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.994213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:07.995150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:07.996029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:07.997068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.008460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.019349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.021950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.023467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6556744a-fffe-4b60-87e3-2df459af0333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1407 microversion: 2.20 time: 0.268529 Oct 11 13:28:08.024713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 79/159] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:07 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:28:08.082003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ec8e2f-5c8c-414b-acec-852608b2e0f2", "name": "network-vif-plugged", "status": "completed", "tag": "0831c3f5-2c69-4990-9a5e-7debdae49aaf"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:08.094599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:08.095075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:08.095552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.115575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] Creating event network-vif-plugged:0831c3f5-2c69-4990-9a5e-7debdae49aaf for instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 on hv-cinder-85061 Oct 11 13:28:08.130957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-76ef02ac-cc50-47a4-8ac7-953ee5f622d6 req-c958db26-22b7-4157-8872-e6ee6103b5e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049597 Oct 11 13:28:08.132538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 80/160] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:08.159940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.168245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bda828e7-b2c1-4c51-ba5f-1532c0c0eee9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.195864 Oct 11 13:28:08.169092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:07 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:08.360732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:08.361395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:08.365205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:08.366076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:08.367969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:08.368483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:08.368914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.369602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:08.370048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:08.370472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.373952 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:08.374509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:08.375009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.375903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:08.376776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:08.377436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:08.776320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.786747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ba49e4ef-4202-4bd1-9ace-f36fc4f4626b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.430974 Oct 11 13:28:08.787630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:08 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:08.814301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:08.822737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cd824adf-17d8-497b-bcbc-2e51606a466b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.462448 Oct 11 13:28:08.823629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 82/163] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:08 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:08.995207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:08.996841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.005545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.006582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.007155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.008181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.008834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.009257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.052082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:09.052707 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.060753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.061239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.061665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.062359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.062803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.063229 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.104162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:09.189350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:09.203863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1fffb455-53d6-4bec-ab4d-256e47417f2b tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.209952 Oct 11 13:28:09.216988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 82/164] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:08 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:09.223396 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:09.224638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.230811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.231476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.232051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.232916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.233503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.234087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.316952 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:09.335319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:09.336859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:09.338519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5f0d9f44-69e2-43f2-ae61-656aa53a7645 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1599 microversion: 2.20 time: 0.290264 Oct 11 13:28:09.339041 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 83/165] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:28:09 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1599 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:28:09.365575 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:09.365783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.373921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.374529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.375250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.376434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.377151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.379457 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.471492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:09.482047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-45a47551-0f3b-4b6d-82a9-e704d6d82650 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.263168 Oct 11 13:28:09.482706 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:09 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:09.527595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-adc11e4a-36c7-450d-8fa2-4c3bc039b26a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.166197 Oct 11 13:28:09.528187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 84/167] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Oct 11 13:28:09 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:28:09.810547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:09.811131 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.819165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.819858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.821157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.822160 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.822611 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.823198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.845218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:09.845827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:09.857225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.857715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.858145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:09.858839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:09.859276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:09.859854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:10.198265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:10.210540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d79c536c-abee-4670-b18e-eb973ed6ee47 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.368786 Oct 11 13:28:10.231955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 85/168] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:09 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:10.243910 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:10.244967 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:10.245642 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:10.255616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:10.256101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:10.256713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:10.256959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-93462c9e-e884-426d-96a9-5f0efab2c45e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.450875 Oct 11 13:28:10.257464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:09 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:10.258074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:10.258532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:10.258956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:10.515850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:10.517584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:10.537027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:10.539096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:10.539933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:10.541056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:10.541859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:10.542575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:10.630563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:10.639289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-67e81e17-4ce9-4f9c-a652-6c222304227d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.406301 Oct 11 13:28:10.642024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 86/170] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:10 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:11.160882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:11.173115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3a8f8836-fc94-4689-bdf6-1427e2a00118 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.670179 Oct 11 13:28:11.187823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 85/171] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:10 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:11.239580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:11.240708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:11.249779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.252783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.255244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.256098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.257168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.258758 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.285980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:11.287519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:11.298766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.304076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.304939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.306363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.307024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.308478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.778392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:11.792924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7f782f02-f90a-43b5-9561-594976e8bbab tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.557500 Oct 11 13:28:11.798162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 87/172] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:11 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:11.806843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf33db-3a51-4c5a-af47-00e632d2cbb9", "name": "network-vif-plugged", "status": "completed", "tag": "ff1917f6-b480-42fc-aa3c-be06bebf4ac3"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:11.823769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:11.841749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3fd92a7c-10fa-4856-8574-534c06f68240 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.558520 Oct 11 13:28:11.842970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.843651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.844445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.845658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 86/173] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:11 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:11.854594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:11.855206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:11.857559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] Creating event network-vif-plugged:ff1917f6-b480-42fc-aa3c-be06bebf4ac3 for instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 on hv-cinder-85061 Oct 11 13:28:11.864052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-478f12bb-cd44-4fbe-9397-e481cc964d34 req-5a61dc01-6e56-462c-9055-bc2446525c13 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063646 Oct 11 13:28:11.865011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 88/174] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:11.881478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.882515 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.883633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:11.884582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:11.885038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:11.885524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.143002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:12.180058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.185052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:12.198425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.200579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.211021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a84a7cd4-28a0-4772-8a40-929efab72d3d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.358950 Oct 11 13:28:12.215181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 87/175] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:11 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:12.234591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:12.238450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:12.249815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] Creating event network-changed:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:28:12.259781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.262605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.263091 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.268364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.270460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.271497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.277639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-066062a5-db88-4da2-b9d9-aebd63e9c03f req-a3757d31-5788-4ed9-b6f6-9341cf83caea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138766 Oct 11 13:28:12.282920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 89/176] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:28:12.503372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:12.515504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9e068163-6fc6-4a3e-9d08-c92541797d2f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.298351 Oct 11 13:28:12.516254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 88/177] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:12 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:12.823544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:12.824746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:12.836515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.837555 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.838395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.839331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.840292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.840894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.870607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:12.871729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:12.884381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.885092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.885676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:12.887535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:12.888160 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:12.891031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.124010 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:13.131923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c5c9ee5e-1544-4365-a13b-e7fcd139b5ca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.265552 Oct 11 13:28:13.134593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 89/178] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:12 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:13.140809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:13.150987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-08bd0d8c-3cca-4a75-826c-6157a6b8a9bd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.332541 Oct 11 13:28:13.151569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 90/179] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:12 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:13.234633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:13.235237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:13.245531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:13.246269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:13.246887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.247947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:13.248676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:13.249339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.444763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:13.454928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b91ee23a-16a6-4c51-8640-0a9a6de4c72a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1315 microversion: 2.1 time: 0.223837 Oct 11 13:28:13.468801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:13 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:13.538972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:13.539702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:13.550400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:13.551003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:13.551452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.552165 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:13.552718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:13.553022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.779385 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:13.787508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0812cb0a-6f0e-4ed7-92bc-e9a4f289b36e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.252409 Oct 11 13:28:13.801556 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:13 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:13.915572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a", "name": "network-vif-plugged", "status": "completed", "tag": "40098450-36a3-4009-9731-eb6463cc6f92"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:13.942779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:13.943506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:13.944148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:13.959822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] Creating event network-vif-plugged:40098450-36a3-4009-9731-eb6463cc6f92 for instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a on hv-cinder-85061 Oct 11 13:28:13.967332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-90df2804-48c1-4077-ae17-5d77ae111d9d req-6e5db28e-a3fb-4922-b7c7-04850fcfefa6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065906 Oct 11 13:28:13.968479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 91/182] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:14.159246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:14.159929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:14.166419 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.167247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.167772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.168839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.170389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.171208 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.180746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:14.181618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:14.194451 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.197142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.197588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.200932 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.201544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.203512 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.438770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:14.447330 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-53dc71de-4522-4809-9c57-49448593b1e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.293384 Oct 11 13:28:14.449151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:14 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:14.485219 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:14.485851 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:14.492192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.493263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.493833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.495162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.496011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.496588 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.508290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:14.518394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-90b50715-7c50-41b6-ab98-4389f0492b54 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1367 microversion: 2.1 time: 0.346692 Oct 11 13:28:14.519114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 92/184] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:14 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:14.664538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:14.677753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ede456a6-368c-4327-bca1-aa6818122fcd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1503 microversion: 2.1 time: 0.196473 Oct 11 13:28:14.679020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 93/185] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:14 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:14.815265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:14.815934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:14.825807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.826354 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.826789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:14.829135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:14.829862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:14.830737 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.012403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:15.022732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-36c14dd1-146c-4288-b4d9-976f230ffb15 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.211465 Oct 11 13:28:15.024305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 93/186] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:14 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:15.471134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:15.471776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:15.479740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.480328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.481099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.482097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.482632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.483235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.541536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:15.542408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:15.552986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.553650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.554506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.555564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.556177 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.556732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.793834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:15.796780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:15.813139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f478659d-a322-4306-86f4-edad6f97bbfd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1322 microversion: 2.1 time: 0.345655 Oct 11 13:28:15.826793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 94/187] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:15 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:15.827042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-97fdc7e2-4696-49b2-a09c-691c292ee717 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1556 microversion: 2.1 time: 0.277018 Oct 11 13:28:15.828149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 94/188] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:15 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1556 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:15.856922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:15.857438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:15.864062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.864582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.865167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.865890 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:15.866582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:15.867010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:15.957427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-947aa67e-658a-46f2-8135-f8a741346e46 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107265 Oct 11 13:28:15.958256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:28:15 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:16.046265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:16.046895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:16.055151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.055629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.056054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:16.056851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.062175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.062873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:16.324630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929258ef-9ea7-427a-bded-45dc97a9408e"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:16.327571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:16.336657 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.337903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.339778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:16.341294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.341842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.342382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:16.508672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:16.518949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-98c8c85c-6a2f-400b-861c-12bc0ed7a078 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.476597 Oct 11 13:28:16.519608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 95/190] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:16 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:16.843267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:16.847094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:16.857577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.858845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.859536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:16.861701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:16.862228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:16.863000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.128733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:17.133903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:17.141302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8f818952-0437-45c1-88e4-b6ecd751ddd4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1517 microversion: 2.1 time: 0.306245 Oct 11 13:28:17.166349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:16 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1517 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:17.172642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:17.184584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:17.192315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.193334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.194132 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.196016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.198374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.198988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.272546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'flavor' on Instance uuid 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:28:17.443943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4f34e920-e71d-459f-b1e7-b023eb89f90b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9/action" status: 200 len: 32 microversion: 2.1 time: 0.275367 Oct 11 13:28:17.445742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 97/192] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:28:17 2022] POST /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:28:17.471151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:17.472275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:17.490095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.491062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.498305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.499111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.499586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.499994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.707749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:17.721908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d0972522-3a71-43d1-8f0b-4b3996cae5df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.263967 Oct 11 13:28:17.725103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 98/193] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:17 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:17.735979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:17.737291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:17.746258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.747437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.748485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.749582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:17.749696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:17.750075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:17.921958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c8ee836a-2704-42a6-9b5e-28d013e616c1 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "POST /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.602454 Oct 11 13:28:17.923148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 96/194] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:28:16 2022] POST /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7/os-volume_attachments => generated 194 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:28:18.049359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:18.072732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2729ba3a-f353-4c24-8748-e2522982fa29 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1362 microversion: 2.1 time: 0.344396 Oct 11 13:28:18.078579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 99/195] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:17 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:18.101686 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ec8e2f-5c8c-414b-acec-852608b2e0f2", "tag": "0831c3f5-2c69-4990-9a5e-7debdae49aaf"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:18.135359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:18.136165 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:18.138172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:18.166305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] Creating event network-changed:0831c3f5-2c69-4990-9a5e-7debdae49aaf for instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 on hv-cinder-85061 Oct 11 13:28:18.175931 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-a7d678dd-dbb5-4f2a-9a50-f23d0696ebc8 req-5a85ca35-089c-40ca-b39c-836d488583d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080901 Oct 11 13:28:18.177813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 97/196] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:28:18.750880 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:18.752844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:18.780904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:18.780904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:18.780904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:18.780904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:18.781216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:18.781216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:19.104055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:19.104856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:19.117554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:19.119482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:19.120280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:19.136374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:19.136374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:19.136374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:19.189774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:19.197918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9427666a-e10e-426d-a9f1-b3688c7548e5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.451469 Oct 11 13:28:19.198504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 100/197] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:18 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:19.341348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:19.350908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b3c7ba6d-8980-470d-83f4-95223694c63d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1549 microversion: 2.1 time: 0.251562 Oct 11 13:28:19.351792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 98/198] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:19 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1549 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:28:19.377310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:19.377916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:19.384570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:19.385174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:19.385683 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:19.386400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:19.386853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:19.387276 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:19.477031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3d16565f-4a80-44d4-84ba-177b703fa853 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103671 Oct 11 13:28:19.477818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 101/199] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:28:19 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:20.221747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:20.223100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:20.229774 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:20.230441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:20.231249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:20.232064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:20.232638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:20.233153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:20.488136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:20.497111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d87f608a-d541-44c5-8029-c3838eda5481 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.279603 Oct 11 13:28:20.515222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 99/200] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:20 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:20.687400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a", "tag": "40098450-36a3-4009-9731-eb6463cc6f92"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:20.697816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:20.698462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:20.698883 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:20.712783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] Creating event network-changed:40098450-36a3-4009-9731-eb6463cc6f92 for instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a on hv-cinder-85061 Oct 11 13:28:20.718476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-8c333c91-bf7d-4f50-956e-17a27a0b3fa4 req-e3f06070-5821-4859-acaf-e71ba78aef61 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035783 Oct 11 13:28:20.719008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 102/201] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:21.520953 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:21.522177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:21.528966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:21.529416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:21.529840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:21.530609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:21.530968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:21.531378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:21.682776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:21.690601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f1a88239-0b06-4ba5-82aa-e551a292507b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.173663 Oct 11 13:28:21.691108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 100/202] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:21 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:22.714039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:22.714772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:22.721400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:22.721875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:22.722307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:22.722984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:22.723430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:22.723848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:22.857800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:22.868903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c4a0243d-c1cd-46a1-8e41-78411d3b7592 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.159133 Oct 11 13:28:22.869466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 103/203] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:22 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:23.895599 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:23.896509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:23.903976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:23.904490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:23.904896 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:23.905593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:23.906034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:23.906450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:23.925847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:24.038837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:24.047914 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7e38b820-e1da-4259-a7ae-290f44f56294 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.158556 Oct 11 13:28:24.048524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 101/204] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:23 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:25.071189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:25.071737 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:25.079677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:25.080189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:25.080629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:25.081359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:25.081839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:25.082339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:25.215422 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:25.224064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6d0b786a-5552-45f0-8f7b-29c9af40eeb6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.156857 Oct 11 13:28:25.224664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 104/205] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:25 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:26.247186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:26.247822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:26.254655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:26.255138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:26.255583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:26.256318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:26.256760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:26.257201 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:26.392604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:26.400609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d1b5432d-07e6-4891-93ed-00c1ab4fcc1d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.157219 Oct 11 13:28:26.401182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 102/206] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:26 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:27.424046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:27.424679 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:27.430886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:27.431336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:27.431768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:27.432495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:27.432948 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:27.433373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:27.562286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:27.572097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dcc8a621-5fed-4d78-a047-7715f87c6f40 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.151864 Oct 11 13:28:27.572826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 105/207] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:27 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:28.595894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:28.596474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:28.603557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:28.604257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:28.604715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:28.605446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:28.605920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:28.606348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:28.777077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:28.784990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-04d25bb4-d4c5-464b-a6bf-054204da5c53 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.192878 Oct 11 13:28:28.785649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 103/208] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:28 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:29.817144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:29.817763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:29.824786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:29.825259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:29.825685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:29.826363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:29.826805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:29.827221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:29.977773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:29.985452 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-35771d4d-93e4-4284-bf23-8ec6d33d5dca tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.172052 Oct 11 13:28:29.986088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 106/209] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:29 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:31.009870 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:31.010743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:31.017457 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:31.018123 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:31.018552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:31.019236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:31.019677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:31.020089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:31.177740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:31.185379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d00354e9-6626-4125-aec3-75016c491460 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.180705 Oct 11 13:28:31.185942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 104/210] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:31 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:32.211982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:32.212668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:32.214590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=77 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:32.219890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:32.220318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:32.220823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:32.221511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:32.221962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:32.222381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:32.366228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:32.378364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4c6decb6-8344-4e2f-b692-65689bf0fd39 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.171959 Oct 11 13:28:32.378966 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 107/211] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:32 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:33.404174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:33.405249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:33.416176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:33.416994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:33.417713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:33.418930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:33.419626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:33.420283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:33.557896 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:33.565701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e0ab72dc-f8c5-443f-b1ef-3cf2d648412a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.167768 Oct 11 13:28:33.566240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 105/212] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:33 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:34.588365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:34.588881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:34.595251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:34.595735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:34.596170 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:34.596885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:34.597343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:34.597767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:34.726468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:34.734234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-44285ec8-ae19-4060-8a00-52a1966659f4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.149932 Oct 11 13:28:34.734803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 108/213] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:34 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:35.761413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:35.762409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:35.766142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=66 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:35.774367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:35.774850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:35.775309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:35.775999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:35.776476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:35.776916 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:35.911226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:35.919420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-49c4c254-47f1-418c-9338-f5f07834a086 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.164377 Oct 11 13:28:35.919919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 106/214] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:35 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:36.287702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:36.288230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:36.294760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.295242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.295672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:36.296394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.296841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.297260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:36.324483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:28:36.427879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1cf17086-1ca7-4a15-8637-7077686fab25 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 204 len: 0 microversion: 2.1 time: 0.146145 Oct 11 13:28:36.428874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 109/215] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:28:36 2022] DELETE /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:28:36.438698 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:36.439228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:36.445274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.445951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.446442 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:36.447225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.447703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.448142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:36.582668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:36.596886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1cf61e69-33eb-4fc2-8f39-448e91bd0c77 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.163538 Oct 11 13:28:36.597467 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 107/216] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:36 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:36.948845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:36.950126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:36.956913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.957268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.957875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:36.958522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:36.959009 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:36.959557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:37.108759 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:37.112377 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:37.117912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-db2e7232-56e9-48f0-b6b1-9277d590f5e7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.178179 Oct 11 13:28:37.131337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 110/217] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:36 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:37.620107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:37.620775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:37.627500 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:37.627985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:37.628464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:37.629155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:37.629600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:37.630026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:37.768789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:37.777338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5892327b-7a28-4dd2-8049-c04379b4c03d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.161077 Oct 11 13:28:37.777942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 108/218] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:37 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:38.145750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:38.146800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:38.154195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:38.154668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:38.155096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:38.155778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:38.156259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:38.156679 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:38.291375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:38.299088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c90d0774-8097-42a4-b8ca-f26395f57f5f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.160164 Oct 11 13:28:38.299629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 111/219] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:38 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:38.800346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:38.800874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:38.807548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:38.808019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:38.808476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:38.809158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:38.809608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:38.810025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:38.952720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:38.961822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-545e0b0b-36ee-41c8-8fcf-a215ff46db08 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.165202 Oct 11 13:28:38.962396 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 109/220] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:38 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:39.325894 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:39.326707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:39.336729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:39.337516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:39.338242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:39.339358 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:39.340177 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:39.340853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:39.469945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:39.477684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ad2be4f4-3de5-4947-a58f-4881e3d3dcbf tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.158398 Oct 11 13:28:39.478226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 112/221] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:39 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:39.989046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:39.990789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:40.001833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:40.002621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:40.003326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:40.004519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:40.005274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:40.005972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:40.143568 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:40.152208 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-95826506-c7b5-4047-88f1-4bc1f278c7b4 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.169692 Oct 11 13:28:40.152808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 110/222] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:39 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:40.509297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:40.510097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:40.517922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:40.518519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:40.519081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:40.519938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:40.520514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:40.521044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:40.662950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:40.670797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-170e8aa1-cb48-48a9-96b6-23e9d162eda2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.167819 Oct 11 13:28:40.671452 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 113/223] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:40 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:41.174871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:41.175471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:41.182418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:41.182904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:41.183336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:41.184068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:41.184585 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:41.185005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:41.317807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:41.326318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cc60085d-552a-4914-85d4-7678c7081947 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.155342 Oct 11 13:28:41.326920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 111/224] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:41 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:41.697700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:41.698686 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:41.708788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:41.709582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:41.710435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:41.711123 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:41.711576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:41.711998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:41.843943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:41.851761 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6d89e7a4-c2a8-4fad-8b65-cd48aed19ab7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.160463 Oct 11 13:28:41.852298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 114/225] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:41 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:42.348360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:42.348959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:42.356070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:42.356583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:42.357012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:42.357705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:42.358151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:42.358563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:42.495936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:42.504518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4d2971ba-1e26-441e-8f1b-40362aee4431 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.159986 Oct 11 13:28:42.505086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 112/226] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:42 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:42.880072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:42.880675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:42.887386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:42.887863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:42.888345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:42.889022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:42.889475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:42.889897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:43.021633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:43.029413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4cb87bbd-0730-4533-a15e-fb027ad38312 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.153148 Oct 11 13:28:43.029987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 115/227] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:42 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:43.531447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:43.532461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:43.541643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:43.542129 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:43.542563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:43.543254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:43.543706 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:43.544149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:43.680779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:43.689514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b165340d-7893-4008-9d1f-4cf166fd46c7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.164453 Oct 11 13:28:43.690059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 113/228] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:43 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:44.059036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:44.060016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:44.069917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:44.070705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:44.071394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:44.072600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:44.073339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:44.074445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:44.210793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:44.218928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b837bf41-6837-4e42-90d8-ed76d403232b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.166557 Oct 11 13:28:44.219663 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 116/229] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:44 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:44.715513 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:44.716351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:44.724849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:44.725443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:44.725984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:44.726848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:44.727408 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:44.727934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:44.864586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:44.873045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f6ccf074-2131-4788-b2f0-a21e449d4d67 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.162552 Oct 11 13:28:44.873610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 114/230] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:44 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:45.249806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:45.250823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:45.259544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:45.260028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:45.260493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:45.261179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:45.261630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:45.262061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:45.400813 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:45.409085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-eafe6f4e-de27-4589-8269-a85101a224c9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.168017 Oct 11 13:28:45.409697 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 117/231] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:45 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:45.900560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:45.901442 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:45.912482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:45.913416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:45.913848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:45.914529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:45.914981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:45.915402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:46.048340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:46.056488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-76ecc38c-2cf5-442d-8a83-d9b9f4d4bbc0 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1555 microversion: 2.1 time: 0.162461 Oct 11 13:28:46.057059 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 115/232] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:45 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:46.435114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:46.435728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:46.442231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:46.442726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:46.443154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:46.443905 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:46.444390 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:46.444813 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:46.601338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:46.609146 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ec5e2573-5d58-45a7-a1df-3c2336fdffcc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.177937 Oct 11 13:28:46.609714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 118/233] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:46 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:46.807740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea082e03-8b96-4006-82c8-1e376306d3e7", "name": "network-vif-deleted", "tag": "1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:28:46.817760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:46.818243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:46.818664 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:46.830432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] Creating event network-vif-deleted:1c8fc817-72b0-4d31-a3a3-5c0f6e449ceb for instance ea082e03-8b96-4006-82c8-1e376306d3e7 on hv-cinder-85061 Oct 11 13:28:46.835710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-5eed8267-2781-45df-85ff-d2dfeb59948a req-3e413c8b-a256-489b-a10f-f79402674f68 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031967 Oct 11 13:28:46.836424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 116/234] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:28:47.083519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:47.084449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:47.091336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:47.091813 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:47.092278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:47.092960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:47.093410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:47.093826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:47.161833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:47.170316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-47c6f68b-e6e6-4cfe-bea5-ad8c144f947a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.093365 Oct 11 13:28:47.170891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 119/235] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:47 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:47.637815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:47.638944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:47.649018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:47.649504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:47.649942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:47.650659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:47.651112 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:47.651534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:47.795253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:47.804041 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-85021be8-93fc-40c4-ab2e-8647ab9ac2ea tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.173046 Oct 11 13:28:47.804641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 117/236] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:47 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:48.197229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:48.198217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:48.208538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:48.209362 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:48.210098 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:48.211221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:48.212075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:48.212814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:48.278242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:48.286801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fbf45af9-90cb-4bcf-b2d4-aae02e0192ca tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.096180 Oct 11 13:28:48.287360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 120/237] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:48 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:48.826783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:48.827399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:48.834236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:48.834727 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:48.835163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:48.835854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:48.836339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:48.836766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:48.964837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:48.970229 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:48.978079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2dbbc315-c490-4d10-abf7-322ae34d4921 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.154798 Oct 11 13:28:48.978577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 118/238] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:48 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:49.312754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:49.313288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:49.319541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:49.320022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:49.320484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:49.321175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:49.321626 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:49.322044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:49.390947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:49.399924 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a9c8e0cf-a440-485d-b940-77634f68d26a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.091114 Oct 11 13:28:49.400535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 121/239] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:49 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:50.004284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:50.005279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:50.016180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:50.017397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:50.018045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:50.019175 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:50.019882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:50.020636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:50.157913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:50.165695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ef206a36-7ebc-4987-a495-9c459c97dfad tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.167959 Oct 11 13:28:50.166232 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 119/240] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:49 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:50.426584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:50.427739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:50.437832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:50.438630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:50.439324 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:50.440577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:50.441332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:50.442057 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:50.503451 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:50.512559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-46cdd8d1-2063-4429-9c54-91f0fbe2e0fd tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.092442 Oct 11 13:28:50.513129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 122/241] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:50 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:51.189444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:51.190120 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:51.197036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:51.197525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:51.197962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:51.198655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:51.199111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:51.199544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:51.535130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:51.535689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:51.542866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:51.543480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:51.544093 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:51.545207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:51.545846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:51.546456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:51.549894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:51.558062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-001d4eea-27c2-4ae8-8c21-c3685ee6130b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.372647 Oct 11 13:28:51.558645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 120/242] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:51 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:51.609901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:51.620805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9637f56d-e06b-41bf-9511-02a4bc3a2396 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.089679 Oct 11 13:28:51.621346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 123/243] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:51 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:52.585006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:52.585992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:52.597188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:52.597984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:52.598711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:52.599845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:52.600646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:52.601350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:52.643307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:52.643915 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:52.650449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:52.650931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:52.651363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:52.652084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:52.652553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:52.652971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:52.727066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:52.735600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6264283f-9b9a-4b94-b65a-cab381585cb7 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.096376 Oct 11 13:28:52.736210 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 124/244] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:52 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:52.757936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:52.765688 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2a4f7ee8-483b-4f9f-b74b-9261b3c11eb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.187070 Oct 11 13:28:52.766254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 121/245] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:52 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:53.762126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:53.763187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:53.773535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:53.774442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:53.774884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:53.775594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:53.776050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:53.776514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:53.788817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:53.789421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:53.796233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:53.796712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:53.797139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:53.797842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:53.798285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:53.798730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:53.845534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:53.854007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-51952d1e-3f6b-4529-957f-6c52e7d97ebb tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1346 microversion: 2.1 time: 0.098267 Oct 11 13:28:53.854577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 125/246] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:53 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:53.932069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:53.939964 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e038fd95-dfcb-44e7-93e6-16b2c5a877ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.154987 Oct 11 13:28:53.940577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 122/247] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:53 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:54.877441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:54.878041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:54.886828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:54.887300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:54.887728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:54.888441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:54.888875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:54.889330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:54.920260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:54.920747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:54.921178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:54.921631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lazy-loading 'fault' on Instance uuid ea082e03-8b96-4006-82c8-1e376306d3e7 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:28:54.962853 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:54.963459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:54.968497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e126b005e149258013ce3b6cf15524', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2adf8ac988764dc29c6f0442b2398124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:54.970184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:54.970687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:54.971116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:54.971916 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:54.972387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:54.972816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:54.978393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5e7c208b-1ef9-46dc-b703-e7410095b45d tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 200 len: 1351 microversion: 2.1 time: 0.104679 Oct 11 13:28:54.978393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 126/248] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:54 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:55.107663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:55.119496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-286a46dd-936f-453d-967c-7aec4d59d0da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.160421 Oct 11 13:28:55.120432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 123/249] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:54 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:56.000505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:56.001469 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:56.007620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.008221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.008726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.009497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.010128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.010553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.014631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:28:56.025893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] HTTP exception thrown: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Request method failure captured: Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 HTTP/1.1 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW81QjtyVMd64NSAcnwWTt4FibdgomkVhZeMiZssRtwqrFneWfCA4Sif5jsPLBsvwOn2ROciKrMbY3FtlXdyiPVQ3Hah25rG64bl79OL6Ar5uirT62IVN7xSa0XEtmJMS_tgPvY_22nMV4Ix_B-m6kd-SyyKMZOYAsQaFoTKBMvOPuU Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:28:56.031503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}] Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: e4e126b005e149258013ce3b6cf15524 Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.033005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'ea082e03-8b96-4006-82c8-1e376306d3e7'} Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:28:56.033791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.036198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.037939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Returning 404 to user: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:28:56.037939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-54c77cd6-bf5b-46c3-804e-6b914b662841 tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 404 len: 111 microversion: 2.1 time: 0.036156 Oct 11 13:28:56.037939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 127/250] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:55 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:28:56.154004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:56.154624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:56.160911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:56.161416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.161895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.162492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.163191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.163650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:56.163761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.164227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.170992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.171618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.172734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.173623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:56.174227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:56.174797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:56.188608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] HTTP exception thrown: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Request method failure captured: Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7/os-volume_attachments HTTP/1.1 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW81QjtyVMd64NSAcnwWTt4FibdgomkVhZeMiZssRtwqrFneWfCA4Sif5jsPLBsvwOn2ROciKrMbY3FtlXdyiPVQ3Hah25rG64bl79OL6Ar5uirT62IVN7xSa0XEtmJMS_tgPvY_22nMV4Ix_B-m6kd-SyyKMZOYAsQaFoTKBMvOPuU Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:28:56.195661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}] Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: e4e126b005e149258013ce3b6cf15524 Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.197090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'server_id': 'ea082e03-8b96-4006-82c8-1e376306d3e7'} Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:28:56.197869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:56.198865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:28:56.199931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Returning 404 to user: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:28:56.199931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-43ca52f5-4218-4708-9ae6-5bfa545e06aa tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040737 Oct 11 13:28:56.199931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 128/251] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:28:56 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:28:56.309043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:56.317848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-81db9871-f503-4a20-9666-f552af03fd52 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.179544 Oct 11 13:28:56.332407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 124/252] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:56 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:57.343005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:57.343798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:57.360465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.361067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.361562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.362503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.363085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.363617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.435487 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:57.436569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:57.444057 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.444868 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.445401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.446205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.446755 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.447403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.465264 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] HTTP exception thrown: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Request method failure captured: Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 HTTP/1.1 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW81QjtyVMd64NSAcnwWTt4FibdgomkVhZeMiZssRtwqrFneWfCA4Sif5jsPLBsvwOn2ROciKrMbY3FtlXdyiPVQ3Hah25rG64bl79OL6Ar5uirT62IVN7xSa0XEtmJMS_tgPvY_22nMV4Ix_B-m6kd-SyyKMZOYAsQaFoTKBMvOPuU Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:28:57.472957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}] Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: e4e126b005e149258013ce3b6cf15524 Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.474143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'ea082e03-8b96-4006-82c8-1e376306d3e7'} Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:28:57.474929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.475961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.480859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Returning 404 to user: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:28:57.482504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3f0a6129-d074-4591-9b80-c435d5d7469a tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 404 len: 111 microversion: 2.1 time: 0.052139 Oct 11 13:28:57.486230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 125/253] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:28:57 2022] DELETE /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:28:57.492237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:57.493167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] [instance: ea082e03-8b96-4006-82c8-1e376306d3e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:57.500624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.501361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.501975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.502900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:57.503553 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:57.504189 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:57.519986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:57.524697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] HTTP exception thrown: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Request method failure captured: Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 HTTP/1.1 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW81QjtyVMd64NSAcnwWTt4FibdgomkVhZeMiZssRtwqrFneWfCA4Sif5jsPLBsvwOn2ROciKrMbY3FtlXdyiPVQ3Hah25rG64bl79OL6Ar5uirT62IVN7xSa0XEtmJMS_tgPvY_22nMV4Ix_B-m6kd-SyyKMZOYAsQaFoTKBMvOPuU Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:28:57.526693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2adf8ac988764dc29c6f0442b2398124"}]}] Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 2adf8ac988764dc29c6f0442b2398124 Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-DeleteServersTestJSON-1642037064 Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: e4e126b005e149258013ce3b6cf15524 Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-DeleteServersTestJSON-1642037064-project Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.528075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'ea082e03-8b96-4006-82c8-1e376306d3e7'} Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:28:57.528983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. Oct 11 13:28:57.544405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:28:57.546293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] Returning 404 to user: Instance ea082e03-8b96-4006-82c8-1e376306d3e7 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:28:57.546293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-910bca90-333c-4057-8b10-81e2a63e633e tempest-DeleteServersTestJSON-1642037064 tempest-DeleteServersTestJSON-1642037064-project] 10.222.0.15 "GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7" status: 404 len: 111 microversion: 2.1 time: 0.040592 Oct 11 13:28:57.546573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7ee23959-9cb0-4c26-8a88-a0b48f7132a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.190271 Oct 11 13:28:57.546671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 126/254] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:57 2022] GET /compute/v2.1/servers/ea082e03-8b96-4006-82c8-1e376306d3e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:28:57.546754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 129/255] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:57 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:58.550667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:58.551251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:58.558125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:58.558604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:58.559033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:58.559849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:58.560361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:58.560786 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:58.726407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:58.738751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-462e5105-64d7-447c-89ae-54b394da6750 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.191961 Oct 11 13:28:58.739941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 127/256] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:58 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:28:59.763137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:28:59.763739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:28:59.771028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:59.771500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:59.772606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:59.773320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:28:59.773770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:28:59.774183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:28:59.904471 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:28:59.914116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7a74de0a-b460-4857-8452-901884863d59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.154971 Oct 11 13:28:59.914945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 130/257] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:28:59 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:00.940784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:00.941400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:00.951518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:00.952221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:00.952815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:00.953699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:00.954301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:00.954878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:01.114426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:01.123687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-797c3b4e-fa0b-4133-8dc3-416f2501e411 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.186868 Oct 11 13:29:01.124311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 128/258] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:00 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:02.148234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:02.149183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:02.155503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:02.156404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:02.156836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:02.157494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:02.158126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:02.158546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:02.292460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:02.300225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4513bfc9-4b8d-430c-8587-c2ed5051c3b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.156465 Oct 11 13:29:02.300942 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 131/259] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:02 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:03.323943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:03.324579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:03.331037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:03.331586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:03.332212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:03.332920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:03.333384 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:03.333994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:03.514894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:03.523128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-408189ea-3e97-4766-ab7c-d71d2ef7c91a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.203479 Oct 11 13:29:03.523710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 129/260] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:03 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:04.550668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:04.552064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:04.555309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:04.562140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:04.562695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:04.563422 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:04.564384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:04.564911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:04.565550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:04.725410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:04.733960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4a13b504-7da0-4303-a764-496f251757e6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.187605 Oct 11 13:29:04.734527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 132/261] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:04 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:05.757077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:05.758763 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:05.769682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:05.770511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:05.771181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:05.772218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:05.772849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:05.773485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:06.062821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:06.075106 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3367d8b9-362a-4418-83e2-e74cc16797a8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.319122 Oct 11 13:29:06.076036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 130/262] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:05 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:07.105058 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:07.106035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:07.116014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:07.116854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:07.117536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:07.118693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:07.119490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:07.119911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:07.260612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:07.268860 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a628919b-abc9-475e-beea-b05dad08fbe5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.170322 Oct 11 13:29:07.269427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 133/263] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:07 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:08.298066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:08.299094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:08.302960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=50 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:08.311690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:08.312546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:08.313273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:08.314412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:08.315168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:08.315889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:08.457521 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:08.466036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fbcdc50b-19e9-46bc-a2a8-065353e6e838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.174395 Oct 11 13:29:08.466589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 131/264] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:08 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:09.493619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:09.494595 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:09.501585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:09.502117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:09.502594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:09.503349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:09.503846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:09.504351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:09.649774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:09.657956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8e1d8da4-d9cd-45a9-9404-cc4061829f34 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.171187 Oct 11 13:29:09.658524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 134/265] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:09 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:10.685806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:10.686831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:10.697686 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:10.698170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:10.698609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:10.699283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:10.699760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:10.700216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:10.846379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:10.858989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-82948739-c7a7-4ef1-8e65-c7650d339f87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.179360 Oct 11 13:29:10.859768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 132/266] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:10 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:11.893996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:11.894993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:11.903531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:11.904014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:11.904501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:11.905186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:11.905643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:11.906061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:12.056642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:12.066625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-81f08f18-daab-414c-b939-86441b27d400 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.179199 Oct 11 13:29:12.075577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:11 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:13.093150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:13.093757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:13.100513 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:13.100986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:13.101422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:13.102105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:13.102732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:13.103153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:13.238785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:13.246628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9ba27a8a-a021-41c2-821f-bfb02f34c4fc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1523 microversion: 2.1 time: 0.157980 Oct 11 13:29:13.247268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:13 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:14.271085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:14.273155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:14.282005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:14.282812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:14.283456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:14.284930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:14.285647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:14.286525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:14.511667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:14.520851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2dbb3e58-9b38-4533-b73a-25d429aeb6b5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1503 microversion: 2.1 time: 0.254850 Oct 11 13:29:14.536616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 136/269] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:14 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1503 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:14.545368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:14.546240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:14.552685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:14.553246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:14.553742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:14.554526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:14.556785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:14.557417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:14.729190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:14.738151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1b23bf2a-f1bc-421a-a4b3-bcfbe0df2be5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1515 microversion: 2.1 time: 0.196787 Oct 11 13:29:14.738737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:14 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:16.313692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:16.315903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:16.322328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:16.322822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:16.323263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:16.323999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:16.324499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:16.324925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:16.358446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'flavor' on Instance uuid 7d119505-75d4-4f57-8292-83839956f749 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:29:16.448169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a641409e-9125-4f62-95fc-8dd7888875a1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/action" status: 200 len: 32 microversion: 2.1 time: 0.139165 Oct 11 13:29:16.449481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 137/271] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:29:16 2022] POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:29:16.458482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:16.459060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:16.467509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:16.468192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:16.468846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:16.469652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:16.470470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:16.471490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:16.670718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:16.682460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a79e7ab2-5a64-4d75-8af5-31e05a1fb009 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.227615 Oct 11 13:29:16.685561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 135/272] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:16 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:17.707801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:17.718285 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:17.725979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:17.726953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:17.727589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:17.729051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:17.729984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:17.730921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:17.919251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:17.929016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3903c06e-601b-4c59-ac7c-5e91fcd16a13 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.226410 Oct 11 13:29:17.929599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:17 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:18.954041 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:18.954750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:18.961522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:18.961621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:18.962007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:18.962676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:18.963126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:18.963544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:19.100439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:19.104032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:19.109915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d5ca77bd-352f-45c5-9404-e8d88da4ebb4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.160626 Oct 11 13:29:19.110490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 136/274] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:18 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:20.132608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:20.133237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:20.139439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:20.139939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:20.140410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:20.141102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:20.141864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:20.142287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:20.274946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:20.283684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-aa4d974b-a16e-41aa-8813-e91195aec4f6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.154892 Oct 11 13:29:20.288163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 139/275] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:20 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:20.824903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655329413", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "networks": [{"uuid": "bbcf9372-ba01-4b44-bdd1-6d247f383b68"}]}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:20.907109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] validate_networks() for [('bbcf9372-ba01-4b44-bdd1-6d247f383b68', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:29:21.306736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:21.307464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:21.313541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:21.314022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:21.314460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:21.315155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:21.315605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:21.316027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:21.467926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:29:21.468450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:29:21.469169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:29:21.469831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:29:21.470369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:29:21.480695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:21.481195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:21.481615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:21.482366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:21.482810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:21.483274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:21.500907 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Getting quotas for project 05aa2418cebe4625b97d8ef5baf70a35. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:29:21.504926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Getting quotas for user b1146abe4f9042968fd32a639cd504bc and project 05aa2418cebe4625b97d8ef5baf70a35. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:29:21.517349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:29:21.517680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:21.519746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:29:21.527019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-26817d64-6143-4e9e-9a2c-ed4441e1836e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.223880 Oct 11 13:29:21.527973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 140/276] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:21 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:21.582543 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c925e8b1-e412-4329-8172-4dbc12c228b2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769568 Oct 11 13:29:21.583912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 137/277] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:29:21.598292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3beb7d2b-cd77-4436-a2c2-082d8230f5b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:21.599027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3beb7d2b-cd77-4436-a2c2-082d8230f5b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:21.654480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3beb7d2b-cd77-4436-a2c2-082d8230f5b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:21.662458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3beb7d2b-cd77-4436-a2c2-082d8230f5b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1213 microversion: 2.1 time: 0.069050 Oct 11 13:29:21.668337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 141/278] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:21 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:22.552244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:22.552858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:22.564483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:22.566030 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:22.566752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:22.567968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:22.568666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:22.569326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:22.689237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:22.689894 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:22.697084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:22.697868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:22.698589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:22.699282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:22.699878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:22.700469 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:22.735717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:22.744900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a734a1eb-e30d-4eec-8049-e184b077a29f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.196916 Oct 11 13:29:22.746133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 138/279] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:22 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:22.797106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:22.810331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5dbec127-415e-4670-86e2-acdf07551b08 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1265 microversion: 2.1 time: 0.126863 Oct 11 13:29:22.810972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 142/280] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:22 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:23.770079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:23.770691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:23.779226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:23.780046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:23.780812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:23.781788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:23.782443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:23.783109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:23.835831 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:23.837707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:23.855454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:23.856673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:23.857111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:23.858002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:23.858784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:23.859351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:24.290512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:24.294331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:24.301315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-21d443e7-bf0f-401c-96b5-e1b3ec0c8b05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.535579 Oct 11 13:29:24.305329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-82010f54-cf2b-4e87-8953-05fdbc256b25 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.474769 Oct 11 13:29:24.306097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 143/281] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:23 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:24.312673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 139/282] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:23 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:24.789293 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aefe670b-76c6-40d1-b872-ca614c196a21", "tag": "8ecb7e1d-484d-4d52-b1d1-e57bee3786b8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:24.804159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:24.805016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:24.805650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:24.822367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:24.834031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] Creating event network-changed:8ecb7e1d-484d-4d52-b1d1-e57bee3786b8 for instance aefe670b-76c6-40d1-b872-ca614c196a21 on hv-cinder-85061 Oct 11 13:29:24.842727 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-189373c7-22b0-4eb6-84d4-2a6c40b1579d req-e3881f22-962d-4f57-af2c-edc5964fa9e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054467 Oct 11 13:29:24.844670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 144/283] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:29:25.333967 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:25.335249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:25.340442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:25.341140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:25.342002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:25.342821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:25.343448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:25.344846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:25.345469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:25.346055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:25.347633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:25.348292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:25.349061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:25.349895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:25.351886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:25.352498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:25.572043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:25.575636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:25.582069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-38fb0bff-b2e1-43f0-8bf2-c78ff7005190 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.252856 Oct 11 13:29:25.582644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 140/284] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:25 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:25.583738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-23bf42b4-d272-4389-8986-c57f9f10f75f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.247804 Oct 11 13:29:25.584589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 145/285] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:25 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:26.605925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:26.607228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:26.609839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:26.611768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:26.614169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:26.614678 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:26.615151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:26.615872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:26.616354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:26.616957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:26.620288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:26.621072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:26.622116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:26.623261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:26.623873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:26.624854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:26.827647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:26.834744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:26.837445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b141cb9a-77ce-457b-b4ce-2f94d91b60f7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.235878 Oct 11 13:29:26.838086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 141/286] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:26 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:26.845321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e2da965d-b596-46e6-ad2c-2efbb76774db tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.240752 Oct 11 13:29:26.846546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 146/287] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:26 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:27.860900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:27.861568 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:27.868376 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:27.868883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:27.869319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:27.870190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:27.870675 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:27.871100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:27.874795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:27.875382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:27.881607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:27.882055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:27.882765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:27.883433 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:27.883897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:27.885284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:28.080493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:28.090732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:28.100666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ef50e354-f2f9-48f2-accc-722a5c97d31d tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.229545 Oct 11 13:29:28.112499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 147/288] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:27 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:28.112991 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4615f243-524d-4bc6-b502-4884af9e0f38 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.249060 Oct 11 13:29:28.120497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 142/289] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:27 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:29.124843 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:29.125599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:29.129806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:29.130450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:29.131801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:29.132318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:29.132917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:29.133764 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:29.134409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:29.135019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:29.137281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:29.138246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:29.138858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:29.139738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:29.140973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:29.142011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:29.336675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:29.339221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:29.347337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-10d3cfb6-9c6a-4cf8-8823-184a5edffc42 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.221328 Oct 11 13:29:29.348033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 143/290] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:29 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:29.348167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-23bfc637-4966-4091-a9e4-48717e8621ef tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.227401 Oct 11 13:29:29.348889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 148/291] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:29 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:30.370436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:30.370981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:30.371335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:30.371454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:30.377791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:30.377924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:30.378267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:30.378382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:30.378699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:30.378800 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:30.379403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:30.379544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:30.379852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:30.380001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:30.380325 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:30.380444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:30.575123 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:30.578162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:30.583707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-64bd53e5-cd1f-4fdb-9ebf-02e3be04db7d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.216979 Oct 11 13:29:30.584319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 149/292] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:30 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:30.585963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c45aa8a3-381e-4117-9b0f-92d1ee25f5f7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.219373 Oct 11 13:29:30.586488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 144/293] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:30 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:31.606157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:31.606703 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:31.613387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:31.613861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:31.614768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:31.615223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:31.616434 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:31.620932 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:31.621444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:31.621885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:31.623014 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:31.624234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=6 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:31.627994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:31.629015 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:31.629719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:31.631381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:31.632344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:31.632949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:31.662328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:31.916677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:31.926027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:31.928535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-355c2ab8-a1bd-441b-b9bc-2818e9d4e8ce tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.323041 Oct 11 13:29:31.932013 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 150/294] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:31 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:31.935924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f14d9924-7d05-4d69-b7b8-85c4185cb3be tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.330552 Oct 11 13:29:31.937072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 145/295] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:31 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:32.040367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefe670b-76c6-40d1-b872-ca614c196a21", "name": "network-vif-plugged", "status": "completed", "tag": "8ecb7e1d-484d-4d52-b1d1-e57bee3786b8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:32.051472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:32.052066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:32.052567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:32.067474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] Creating event network-vif-plugged:8ecb7e1d-484d-4d52-b1d1-e57bee3786b8 for instance aefe670b-76c6-40d1-b872-ca614c196a21 on hv-cinder-85061 Oct 11 13:29:32.073405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-91fc79be-e9a6-4c45-8960-f812db4c8564 req-585a9a21-cc04-461a-9067-6ee2ec2acd06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038303 Oct 11 13:29:32.074866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 151/296] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:29:32.955256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:32.956143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:32.961872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:32.962570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:32.963296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:32.963828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:32.964428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:32.965160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:32.966085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:32.966514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:32.974277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:32.974783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:32.975224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:32.975923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:32.976412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:32.976838 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:33.170789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:33.177755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:33.180346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3ce83b61-40f4-4998-8b2d-66e160971365 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.229387 Oct 11 13:29:33.181083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 146/297] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:32 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:33.190175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f16ccac8-e2e6-45e3-8a56-a3761e2bb2e9 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.232337 Oct 11 13:29:33.192537 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 152/298] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:32 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:34.208034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:34.209086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:34.215459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:34.216074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:34.217821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:34.218212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:34.218648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:34.219343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:34.219801 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:34.220254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:34.222263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:34.222746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:34.223180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:34.223870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:34.224341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:34.224762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:34.412883 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:34.415943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:34.420962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-51e079c3-40fc-4ace-90a3-b4d3adc26ec2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.210941 Oct 11 13:29:34.421651 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 153/299] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:34 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:34.424420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-592bc644-516d-4af5-9682-90045681e8cc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.222780 Oct 11 13:29:34.425055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 147/300] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:34 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:35.447933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:35.448651 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:35.450009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:35.450616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:35.450753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=46 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:35.456413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:35.456893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:35.457024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:35.457319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:35.457507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:35.457917 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:35.458032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:35.458449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:35.458614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:35.458859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:35.459066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:35.459484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:35.653698 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:35.656603 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:35.664631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-636f8def-4d29-48f1-bbb1-039741e687b6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.219859 Oct 11 13:29:35.665212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 148/301] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:35 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:35.667981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-493663da-67c1-45c6-a2af-bcf7b06a9aca tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.226497 Oct 11 13:29:35.668609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 154/302] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:35 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:36.690943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:36.692191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:36.696373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:36.697387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:36.701247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:36.701722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:36.702172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:36.702810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:36.703458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:36.703862 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:36.705104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:36.705594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:36.706022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:36.706706 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:36.707172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:36.707594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:36.897988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:36.901033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:36.905980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bb7defd1-4f89-44bf-821e-9f27f5cde6d9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.221766 Oct 11 13:29:36.906523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 149/303] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:36 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:36.909366 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f325a8f2-37b1-48c1-b3d9-3e7773438c36 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.220646 Oct 11 13:29:36.909930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 155/304] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:36 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:37.934036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:37.934587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:37.935716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:37.936387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:37.941437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:37.941921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:37.942355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:37.942503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:37.943037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:37.943188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:37.943465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:37.943617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:37.943882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:37.944151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:37.944622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:37.945037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:38.141674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:38.141972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:38.149914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7993068f-ef3a-44b1-a5bc-2f2f953cfca8 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.218343 Oct 11 13:29:38.150072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-63bbf105-025b-4d64-afee-0c5c6df0454c tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.221739 Oct 11 13:29:38.150828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 150/306] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:37 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:38.150949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 156/306] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:37 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:39.172438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:39.173193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:39.173815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:39.174443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:39.177277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:39.181114 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.181239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.181659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.181803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.182197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.182476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.182900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.183163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.183328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.183604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.183943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.184051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.395648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:39.398786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:39.403620 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2d6b091d-56e8-4692-afe2-f0494efebbf2 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1313 microversion: 2.1 time: 0.234836 Oct 11 13:29:39.404234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 151/307] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:39 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:39.406819 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-642c8e7c-2333-4777-8c3e-4914971247b0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1501 microversion: 2.1 time: 0.237754 Oct 11 13:29:39.407850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 157/308] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:39 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:39.429415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d942535c-42d9-487c-8ba3-1303aa52185d"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:39.431861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:39.438099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.438580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.439018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.439742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.440238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.440663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.463270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] HTTP exception thrown: Cannot 'attach_volume' instance 7d119505-75d4-4f57-8292-83839956f749 while it is in vm_state rescued Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Request method failure captured: Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/os-volume_attachments HTTP/1.1 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 74 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW86WkXZFFRXybGXfjtMsJAfkQa63WbdzIDE7vOsnNzhefqC3u9dLr0PwBz_QNwLRJ_QvPtrrH9YzIgqaXzvCzS4Qag21J41-2hA5KXSNUYi2AJfMonufwXe4fkAxaG0kEWNhu_ykK-VDIHDelxlP2geuUDJ-7vJvVOp7hawt7TnZqM Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:29:39.465445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}] Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b50f86c6209f4a728cf3681a7d0a6765 Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {"volumeAttachment": {"volumeId": "d942535c-42d9-487c-8ba3-1303aa52185d"}} Oct 11 13:29:39.466731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Cannot 'attach_volume' instance 7d119505-75d4-4f57-8292-83839956f749 while it is in vm_state rescued Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'server_id': '7d119505-75d4-4f57-8292-83839956f749', 'body': {'volumeAttachment': {'volumeId': 'd942535c-42d9-487c-8ba3-1303aa52185d'}}} Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d119505-75d4-4f57-8292-83839956f749 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:29:39.467454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7d119505-75d4-4f57-8292-83839956f749 while it is in vm_state rescued Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:29:39.468776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7d119505-75d4-4f57-8292-83839956f749 while it is in vm_state rescued Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Returning 409 to user: Cannot 'attach_volume' instance 7d119505-75d4-4f57-8292-83839956f749 while it is in vm_state rescued {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f9ec828f-719f-47d7-bf75-e544307cf7df tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041421 Oct 11 13:29:39.470168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 152/309] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:29:39 2022] POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:29:39.475842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:39.476403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:39.482959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.483439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.483872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.484588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.485055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.485483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.558861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-464d7a4f-d0bf-43a8-9587-6c41d4d04f6d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/action" status: 202 len: 0 microversion: 2.1 time: 0.086632 Oct 11 13:29:39.559476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 158/310] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:29:39 2022] POST /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:29:39.567936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:39.568646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:39.575022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.575474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.576100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.576828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:39.577285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:39.577714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:39.721807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:39.729691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8dd977c2-f72b-4de9-9c78-41bed71040ba tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1509 microversion: 2.1 time: 0.165623 Oct 11 13:29:39.730256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 153/311] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:39 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:40.432217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:40.433247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:40.443636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:40.444501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:40.445236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:40.446375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:40.447126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:40.447911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:40.577429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:40.585790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-68ac5ba1-a714-4e23-8fac-6946a6489d98 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1497 microversion: 2.1 time: 0.160796 Oct 11 13:29:40.586606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 159/312] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:40 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:40.757518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:40.758395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:40.769329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:40.770125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:40.770888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:40.772106 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:40.772897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:40.773656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:40.793515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:40.910834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:40.918692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-87fb2ce0-ce68-4f64-b621-8d177e49297d tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1509 microversion: 2.1 time: 0.167970 Oct 11 13:29:40.919261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 154/313] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:40 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:41.946025 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:41.947014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:41.953791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:41.954270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:41.954696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:41.955368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:41.955831 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:41.956304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:42.094510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:42.102748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ba2c8cf1-28c1-487e-a4a0-0f518d1f5838 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1509 microversion: 2.1 time: 0.163540 Oct 11 13:29:42.103365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 160/314] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:41 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:42.152469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:42.153000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:42.160052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:42.160569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:42.161430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:42.162297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:42.162746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:42.163167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:42.190416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:29:42.283078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bdd8d519-7860-48ec-8f07-a3cc5101c7c5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 204 len: 0 microversion: 2.1 time: 0.134429 Oct 11 13:29:42.283574 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 155/315] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:29:42 2022] DELETE /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:29:42.291812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:42.292440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:42.298394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:42.298885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:42.299312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:42.300005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:42.300476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:42.300893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:42.304996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:29:42.451322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:42.461130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c262ecba-90bf-4f10-9ae9-8cd5af197eeb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1503 microversion: 2.1 time: 0.173113 Oct 11 13:29:42.462920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 161/316] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:42 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:43.132604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:43.133813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:43.148081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:43.149537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:43.151006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:43.152290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:43.153099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:43.153873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:43.293023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:43.300986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e9997969-ee8e-47b2-9741-471ac529e6b7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1509 microversion: 2.1 time: 0.175459 Oct 11 13:29:43.301522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 156/317] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:43 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:43.485600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:43.486212 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:43.492469 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:43.492946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:43.493388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:43.494074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:43.494715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:43.495140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:43.627954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:43.635693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6bad2535-beb3-41b8-8d09-0fcd7405162f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1503 microversion: 2.1 time: 0.154258 Oct 11 13:29:43.636363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 162/318] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:43 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:44.328252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:44.329244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:44.340171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:44.340999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:44.341780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:44.342924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:44.343685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:44.344466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:44.487650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:44.495710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-63e1a7f8-6cba-41ac-ae50-4e75eeb24554 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1509 microversion: 2.1 time: 0.174254 Oct 11 13:29:44.496318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 157/319] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:44 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:44.658175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:44.658793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:44.665034 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:44.665544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:44.666008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:44.666705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:44.667159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:44.667583 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:44.805215 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:44.813601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-61155a79-9de9-4872-9112-0c08b20fa414 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1503 microversion: 2.1 time: 0.159472 Oct 11 13:29:44.814170 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 163/320] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:44 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:45.519447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:45.521470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:45.532190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:45.533087 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:45.534455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:45.536759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:45.537669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:45.538861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:45.736935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:45.746570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-20d911d7-60dd-4512-ae15-40bbaf4d7079 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1515 microversion: 2.1 time: 0.231472 Oct 11 13:29:45.764792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 158/321] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:45 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1515 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:45.837305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:45.837897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:45.846844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:45.849664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:45.850271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:45.851338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:45.854232 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:45.854843 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:46.092593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aefe670b-76c6-40d1-b872-ca614c196a21", "name": "network-vif-deleted", "tag": "8ecb7e1d-484d-4d52-b1d1-e57bee3786b8"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:46.101880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:46.102770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:46.103343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:46.120650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] Creating event network-vif-deleted:8ecb7e1d-484d-4d52-b1d1-e57bee3786b8 for instance aefe670b-76c6-40d1-b872-ca614c196a21 on hv-cinder-85061 Oct 11 13:29:46.125981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-f729c02b-62ff-4358-b77c-954335731d11 req-51129512-f765-44f0-b55f-5e4b1592d3ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039285 Oct 11 13:29:46.130524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 159/322] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:29:46.155613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:46.163944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-81de826f-2a05-49ee-8586-501dfaa58b4e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1461 microversion: 2.1 time: 0.330495 Oct 11 13:29:46.165017 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 164/323] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:45 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1461 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:47.188370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:47.189414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:47.197107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:47.197595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:47.198050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:47.199016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:47.199433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:47.200089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:47.232232 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:47.233216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:47.233981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:47.234626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lazy-loading 'fault' on Instance uuid aefe670b-76c6-40d1-b872-ca614c196a21 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:29:47.284503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:47.294024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-81e07f60-2653-4af6-8b0a-84f660e5abcd tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1303 microversion: 2.1 time: 0.110039 Oct 11 13:29:47.295451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:47 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:48.320973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:48.321892 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:48.327857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:48.328386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:48.328812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:48.329711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:48.330129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:48.330538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:48.361965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:48.362441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:48.362865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:48.363298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lazy-loading 'fault' on Instance uuid aefe670b-76c6-40d1-b872-ca614c196a21 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:29:48.408353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:48.417676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fc9b6874-48f8-44b4-a3db-31dd1a93006f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1303 microversion: 2.1 time: 0.100469 Oct 11 13:29:48.418659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 165/325] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:48 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:49.443785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:49.444415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:49.452265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:49.452750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:49.453182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:49.453873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:49.454322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:49.454749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:49.485713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:49.486198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:49.486625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:49.487062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lazy-loading 'fault' on Instance uuid aefe670b-76c6-40d1-b872-ca614c196a21 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:29:49.533770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:49.541937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a22cadfb-6280-4b56-a838-8f2293a95066 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 200 len: 1303 microversion: 2.1 time: 0.104266 Oct 11 13:29:49.542495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 161/326] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:49 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:50.568445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:50.569597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: aefe670b-76c6-40d1-b872-ca614c196a21] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:50.579786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:50.580639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:50.581404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:50.582544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:50.583309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:50.584015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:50.599745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] HTTP exception thrown: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Request method failure captured: Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 HTTP/1.1 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW-tAeOCvkaUuirMyfkf_Bw4oc2KElmB4BaQtbSObsDIzlpQBHPLipwcLCVx7eJe1QAAl59hHL0_K8tD2ci58RlbyHeXSBcS40vVur0RswSqwXVqSlwPuli_WQYk5sbgj7EHMfq4hnqiuj8b0A1MgY6OEE1Zci0tIAFNC1c7X5PuIrw Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 05aa2418cebe4625b97d8ef5baf70a35 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesActionsTest-412764957 Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:29:50.602861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/05aa2418cebe4625b97d8ef5baf70a35"}]}] Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesActionsTest-412764957 Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 05aa2418cebe4625b97d8ef5baf70a35 Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesActionsTest-412764957 Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesActionsTest-412764957-project Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b1146abe4f9042968fd32a639cd504bc Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesActionsTest-412764957-project Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. Oct 11 13:29:50.604270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'aefe670b-76c6-40d1-b872-ca614c196a21'} Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:29:50.604988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. Oct 11 13:29:50.606087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:29:50.607140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Returning 404 to user: Instance aefe670b-76c6-40d1-b872-ca614c196a21 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:29:50.607140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-84ab0561-e545-44d1-b90c-9c0d621040b4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21" status: 404 len: 111 microversion: 2.1 time: 0.042366 Oct 11 13:29:50.607140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 166/327] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:50 2022] GET /compute/v2.1/servers/aefe670b-76c6-40d1-b872-ca614c196a21 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:29:50.705776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-324947863", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "networks": [{"uuid": "bbcf9372-ba01-4b44-bdd1-6d247f383b68"}]}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:50.762768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] validate_networks() for [('bbcf9372-ba01-4b44-bdd1-6d247f383b68', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:29:51.131097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:29:51.131490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:29:51.131961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:29:51.132407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:29:51.132829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:29:51.142689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:51.143168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:51.143607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:51.144440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:51.144896 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:51.145321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:51.162382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Getting quotas for project 05aa2418cebe4625b97d8ef5baf70a35. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:29:51.166575 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Getting quotas for user b1146abe4f9042968fd32a639cd504bc and project 05aa2418cebe4625b97d8ef5baf70a35. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:29:51.177750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:29:51.180312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:29:51.238599 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c6c900bb-d863-4286-8cc4-23070bb83511 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536752 Oct 11 13:29:51.239236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 162/328] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:29:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:29:51.250249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-23ddaef9-c20c-4049-bd17-e90ad9f8e7fb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:51.250852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-23ddaef9-c20c-4049-bd17-e90ad9f8e7fb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:51.303700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-23ddaef9-c20c-4049-bd17-e90ad9f8e7fb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:51.310655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-23ddaef9-c20c-4049-bd17-e90ad9f8e7fb tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1213 microversion: 2.1 time: 0.064237 Oct 11 13:29:51.311205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 167/329] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:51 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:51.551182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a107d6fa-9493-422e-a6b4-b4c550fe2602 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: .version_select at 0x7f7a552c9c10>, body: {"keypair": {"name": "tempest-keypair-1636502401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbMB4osJbOiHHJW3269NWI0Yx6C1ubDxWFKkuBoMqx+iGxseIb8d1FDr/+Eal4R1Hc5cuMrvZwwp+gU+0iEAYnRUyPQrKXqXLmbR8JertHYIe3n5Y7p8ER4b2bYQ/TUag=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:51.567412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-a107d6fa-9493-422e-a6b4-b4c550fe2602 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:29:51.576643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-a107d6fa-9493-422e-a6b4-b4c550fe2602 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for user b50f86c6209f4a728cf3681a7d0a6765 and project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:29:51.599971 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a107d6fa-9493-422e-a6b4-b4c550fe2602 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053072 Oct 11 13:29:51.600592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 163/330] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:29:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:29:52.335931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:52.336692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:52.348303 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:52.359715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:52.360501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:52.361386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:52.362074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:52.362508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:52.458967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:52.483351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-afcdf123-6261-4ce5-b466-faeaa7b13167 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1265 microversion: 2.1 time: 0.154618 Oct 11 13:29:52.484345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 168/331] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:52 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:53.125192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1349659457", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1851f7f9-eb71-4d60-a92c-6fbf1b3da357"}], "security_groups": [{"name": "tempest-securitygroup--1843256684"}], "key_name": "tempest-keypair-1636502401", "user_data": "}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:53.229472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] validate_networks() for [('1851f7f9-eb71-4d60-a92c-6fbf1b3da357', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:29:53.508782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:53.509405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:53.515495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:53.515963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:53.516905 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:53.517745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:53.518349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:53.518776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:53.686125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:29:53.686718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:29:53.687340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:29:53.687903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:29:53.688489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:29:53.701014 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:53.701819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:53.702437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:53.703177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:53.703633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:53.704058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:53.724831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:29:53.729112 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Getting quotas for user b50f86c6209f4a728cf3681a7d0a6765 and project 46f14bd1e0fd419383ac2bf2ab87e6d0. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:29:53.736977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:53.742008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:29:53.744542 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:29:53.747329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-524917b0-bbab-46d4-a607-198110df2713 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.242559 Oct 11 13:29:53.748449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 169/332] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:53 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:53.810194 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-901367d7-9695-4861-a6df-287ad34acd45 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.690209 Oct 11 13:29:53.810834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 164/333] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:29:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:29:53.829745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-918ac65d-3bee-4c24-98c0-2b362bbd0879 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:53.830418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-918ac65d-3bee-4c24-98c0-2b362bbd0879 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:53.884945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-918ac65d-3bee-4c24-98c0-2b362bbd0879 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:53.895941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-918ac65d-3bee-4c24-98c0-2b362bbd0879 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1246 microversion: 2.1 time: 0.070186 Oct 11 13:29:53.896553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 170/334] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:53 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:54.180663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e265cc3c-f312-428d-8c94-0a1becdbe95b", "tag": "e7793096-48c4-4707-94a1-4ada9d778d0c"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:29:54.205079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:54.205632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:54.206136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:54.217928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] Creating event network-changed:e7793096-48c4-4707-94a1-4ada9d778d0c for instance e265cc3c-f312-428d-8c94-0a1becdbe95b on hv-cinder-85061 Oct 11 13:29:54.223846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-f9cbdd02-37d2-4d41-8586-21485e148fcd req-e449c867-3681-459d-80c6-ded070a4e290 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047490 Oct 11 13:29:54.224744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 165/335] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:29:54.771444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:54.771936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:54.778217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:54.778888 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:54.779320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:54.780026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:54.780512 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:54.780937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:54.924679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:54.925788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:54.932696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:54.933602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:54.933728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:54.934180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:54.934892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:54.935536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:54.936380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:54.944054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d62f5844-382c-4f8a-9434-0d18e611075e tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.176322 Oct 11 13:29:54.956898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 171/336] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:54 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:55.013273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:55.024147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ddf31b87-4bb8-47d8-965c-da1d5c0d0255 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1298 microversion: 2.1 time: 0.108927 Oct 11 13:29:55.024654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 166/337] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:54 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:29:55.971732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:55.972312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:55.981321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:55.981985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:55.982571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:55.983570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:55.984279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:55.984899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:56.046816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:56.047482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:56.053772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:56.054263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:56.054709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:56.055370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:56.056024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:56.056701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:56.135623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:56.143965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8ec621d5-e927-4b29-8a73-d2d2dab4222f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1298 microversion: 2.1 time: 0.100968 Oct 11 13:29:56.144646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 167/338] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:56 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1298 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:56.153018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:56.161141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1a91a58a-333f-4b8c-bd8d-6ba6bfcc4768 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.195871 Oct 11 13:29:56.161721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 172/339] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:55 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:57.167593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:57.168234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:57.175776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:57.176303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:57.176746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:57.178790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:57.178790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:57.178790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:57.184383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:57.185162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:57.191988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:57.192515 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:57.192950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:57.194027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:57.195082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:57.195082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:57.248999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:57.257393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-abe73fcd-5515-40e7-b201-f9a1c7971e32 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1298 microversion: 2.1 time: 0.093603 Oct 11 13:29:57.258560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 168/340] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:57 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:57.367529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:57.377494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0658ef5a-2301-419b-9b24-ce609f1c2326 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.197503 Oct 11 13:29:57.396429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 173/341] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:57 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:58.283236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:58.283920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:58.290930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:58.291433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:58.291867 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:58.292605 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:58.293054 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:58.293508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:58.355558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:58.364144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-effe6eef-fe52-46b7-9484-10e554a54f00 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1304 microversion: 2.1 time: 0.085513 Oct 11 13:29:58.364792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 169/342] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:58 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:58.411550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:58.412083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:58.418835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:58.419674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:58.420153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:58.421192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:58.421679 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:58.422145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:58.555049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:58.562770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8eba4976-d6af-4feb-b41f-c020b206964f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.155323 Oct 11 13:29:58.563294 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 174/343] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:58 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:59.393673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:59.394691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:59.405584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:59.406083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:59.406523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:59.407221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:59.407680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:59.408110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:59.543433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:59.555144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-951d4443-f617-40c2-9b1d-01ea268c7a31 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.169052 Oct 11 13:29:59.556011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 170/344] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:59 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:29:59.585961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:29:59.586564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:29:59.593155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:59.593644 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:59.594079 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:59.594776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:29:59.595230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:29:59.595655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:29:59.722984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:29:59.734409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-43dbbbee-a3e5-41a5-a6fe-8c8c3a84fe94 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.152299 Oct 11 13:29:59.734977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 175/345] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:29:59 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:00.473921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:00.484157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:00.484664 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:00.485093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:00.496032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] Creating event network-changed:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:30:00.501248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-8dcd3964-c7f5-455e-8efe-907e978bdfbb req-ae846684-c7b9-444e-ba02-d990bea77f36 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031111 Oct 11 13:30:00.501998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 171/346] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:00.577539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:00.578145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:00.584729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:00.585219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:00.585660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:00.586363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:00.586916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:00.587235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:00.717724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:00.727821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fda5e1cb-55dc-4f9d-9e4b-69f9f58acb51 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.153939 Oct 11 13:30:00.728755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 176/347] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:00 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:00.757551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:00.758246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:00.764866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:00.765352 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:00.765799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:00.766804 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:00.767259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:00.767686 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:00.898244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:00.910317 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-82044cc5-64aa-4204-a6b4-93ccf6ac913f tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.156683 Oct 11 13:30:00.911327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:00 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:01.752553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:01.753115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:01.759470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:01.759949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:01.760408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:01.761156 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:01.761529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:01.761951 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:01.893968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:01.901763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-786a49b9-a42d-4487-aa72-1b274b898d73 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.154080 Oct 11 13:30:01.902529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 177/349] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:01 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:01.942958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:01.943558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:01.951101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:01.951603 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:01.952036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:01.952778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:01.953226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:01.953647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:01.957761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:02.106120 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:02.114112 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8506a066-1d69-4ba1-9c4e-f81ebf6235bf tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.175090 Oct 11 13:30:02.114679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 173/350] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:01 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:02.924739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:02.925315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:02.931543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:02.932027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:02.932485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:02.934641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:02.934641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:02.934641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:03.065104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:03.072809 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-09689dcd-e24d-4e74-a12a-cfc705ec9b93 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.152075 Oct 11 13:30:03.073372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 178/351] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:02 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:03.137679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:03.138259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:03.145392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:03.145871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:03.146303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:03.146988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:03.147433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:03.147854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:03.296159 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:03.304506 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5e63dabf-1a30-4636-bb88-b0c0c83faf89 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.170688 Oct 11 13:30:03.305066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 174/352] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:03 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:04.095375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:04.096005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:04.097961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=4 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:04.103298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:04.103782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:04.104245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:04.104941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:04.105393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:04.105818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:04.259005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:04.268368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-383068d3-f50b-40d0-ad2b-ef1bb48f5633 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.176733 Oct 11 13:30:04.269154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 179/353] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:04 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:04.327308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:04.327962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:04.329898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=4 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:04.330709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=16 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:04.337257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:04.337947 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:04.338377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:04.339083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:04.339602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:04.339959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:04.351115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e265cc3c-f312-428d-8c94-0a1becdbe95b", "name": "network-vif-plugged", "status": "completed", "tag": "e7793096-48c4-4707-94a1-4ada9d778d0c"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:04.372342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:04.372832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:04.373263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:04.377911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:04.388230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] Creating event network-vif-plugged:e7793096-48c4-4707-94a1-4ada9d778d0c for instance e265cc3c-f312-428d-8c94-0a1becdbe95b on hv-cinder-85061 Oct 11 13:30:04.406522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-b30b8990-6684-4c94-9e58-23f4a8921629 req-94d300fb-200c-4f36-86d7-abf16fe4c5a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059325 Oct 11 13:30:04.407565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 180/354] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:30:04.520598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:04.520598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-696582d5-62b1-4d9d-b071-942b2d18a1a5 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.196273 Oct 11 13:30:04.520598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 175/355] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:04 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:05.296821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:05.297522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:05.304210 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:05.304690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:05.305119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:05.305802 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:05.306247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:05.306660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:05.436466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:05.444263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-041181c3-3128-406e-a2eb-c106c7a14a7a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.154357 Oct 11 13:30:05.444820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 181/356] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:05 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:05.546321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:05.547346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:05.550925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:05.559480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:05.560311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:05.561027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:05.562274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:05.562726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:05.563148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:05.699267 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:05.709876 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d716001e-5a1f-4f6f-9244-b5224edb78a4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.169287 Oct 11 13:30:05.711112 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 176/357] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:05 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:06.467060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:06.467652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:06.470043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=62 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:06.475508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:06.475981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:06.476437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:06.477103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:06.477564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:06.477986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:06.624642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:06.632758 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-83a4f23c-730d-4b61-99e7-7e562f03a1a6 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.169515 Oct 11 13:30:06.633664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 182/358] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:06 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:06.735469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:06.736069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:06.742855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:06.743340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:06.743765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:06.744493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:06.744945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:06.745386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:06.886779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:06.895483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d3e70416-2484-42e7-9914-c49347de4f19 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.165144 Oct 11 13:30:06.896555 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 177/359] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:06 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:07.661186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:07.662067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:07.672197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:07.673026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:07.673753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:07.674941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:07.675693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:07.676448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:07.920046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:07.920641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:07.927609 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:07.928101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:07.928578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:07.929290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:07.929743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:07.930168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:08.036460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:08.055509 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b667b19c-e5cf-4da3-ab35-4cb4093339c1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.400926 Oct 11 13:30:08.062718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 183/360] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:07 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:08.128380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:08.137459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f1e31789-0969-4b80-8178-b00825f0d506 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1313 microversion: 2.1 time: 0.221473 Oct 11 13:30:08.138255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 178/361] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:07 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:08.355942 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "name": "network-vif-plugged", "status": "completed", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:08.368808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:08.369190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:08.369613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:08.384904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] Creating event network-vif-plugged:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:30:08.396503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-fa940f32-474d-45cb-8e6a-e28130ae943d req-3ac64775-5e14-48a1-a625-2a30b447a6ce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045268 Oct 11 13:30:08.397917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 184/362] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:09.084033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:09.085020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:09.095805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.096348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.096783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.097513 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.097970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.098403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.162805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:09.163508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:09.170298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.170781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.171217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.171909 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.172395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.172820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.282667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:09.290785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d2761dea-7f42-4d06-a064-9d734ff77ae1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.213615 Oct 11 13:30:09.291394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 179/363] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:09 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:09.330327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:09.342385 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ee8cb187-8692-42df-83a4-f7e9e3dba89a tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1497 microversion: 2.1 time: 0.183784 Oct 11 13:30:09.342912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 185/364] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:09 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:09.828018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:09.828255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:09.834336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.834811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.835244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.835920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.836405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.836800 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.861969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:30:09.949963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6bfaf718-f928-4c82-9224-d17aa77f48af tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 204 len: 0 microversion: 2.1 time: 0.125829 Oct 11 13:30:09.950619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 180/365] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:30:09 2022] DELETE /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:30:09.958906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:09.959507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:09.965766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.966282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.966718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:09.967462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:09.967919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:09.968413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:10.107068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:10.116495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-64586e64-d1a1-45fe-a86e-2442c8a80720 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1503 microversion: 2.1 time: 0.161353 Oct 11 13:30:10.116968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 186/366] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:09 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:10.319376 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:10.320541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:10.330425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:10.330900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:10.331332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:10.332017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:10.332504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:10.332929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:10.467933 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:10.475816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6ac3c563-7332-4d50-9e11-910888fe38e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1372 microversion: 2.1 time: 0.163530 Oct 11 13:30:10.476444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 181/367] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:10 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:11.202781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:11.204593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:11.210719 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.211445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.211882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.212597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.213040 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.213462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.348778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:11.356590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cc39732b-b6bb-4270-b555-6e83fc796fa7 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1503 microversion: 2.1 time: 0.160197 Oct 11 13:30:11.357163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 187/368] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:11 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:11.502805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:11.503343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:11.510239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.510714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.511145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.511824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.512305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.512723 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.650673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:11.658949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-16a166dd-9589-4778-a003-fc6febb6a992 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1566 microversion: 2.1 time: 0.161894 Oct 11 13:30:11.659498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 182/369] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:11 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:11.681231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:11.681722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:11.688036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.688690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.689130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.689814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:11.690269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:11.690690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:11.774500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c33e99e2-4772-401c-8802-eb10ab8d3f70 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097105 Oct 11 13:30:11.775095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 188/370] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:30:11 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:12.381311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:12.382129 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:12.388548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:12.389144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:12.389660 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:12.390546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:12.391307 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:12.391830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:12.650703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1146abe4f9042968fd32a639cd504bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05aa2418cebe4625b97d8ef5baf70a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:12.664251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-45b39964-6c6f-48dd-8c79-ad7f454d399b tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 200 len: 1503 microversion: 2.1 time: 0.286985 Oct 11 13:30:12.665595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:12 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:12.687286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e265cc3c-f312-428d-8c94-0a1becdbe95b", "name": "network-vif-deleted", "tag": "e7793096-48c4-4707-94a1-4ada9d778d0c"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:12.698446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:12.699121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:12.699705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:12.714834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] Creating event network-vif-deleted:e7793096-48c4-4707-94a1-4ada9d778d0c for instance e265cc3c-f312-428d-8c94-0a1becdbe95b on hv-cinder-85061 Oct 11 13:30:12.720499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-c9b54f2f-5200-4720-88f4-3dd266387e05 req-d7508d1b-5f3e-4ecf-8d66-e88fc32c6436 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037802 Oct 11 13:30:12.721255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 189/372] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:12.854648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:12.865318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:12.865791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:12.866410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:12.879042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] Creating event network-changed:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:30:12.884874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-739ee996-a1a7-4ccc-8ab3-78141f734934 req-519f4bf1-b1ad-46db-a4cf-249472d19dde service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Oct 11 13:30:12.885519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 184/373] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:13.691536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:13.692571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] [instance: e265cc3c-f312-428d-8c94-0a1becdbe95b] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:13.713893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:13.714395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:13.714850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:13.720585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:13.721224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:13.721819 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:13.745222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] HTTP exception thrown: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Request method failure captured: Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b HTTP/1.1 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW-tAeOCvkaUuirMyfkf_Bw4oc2KElmB4BaQtbSObsDIzlpQBHPLipwcLCVx7eJe1QAAl59hHL0_K8tD2ci58RlbyHeXSBcS40vVur0RswSqwXVqSlwPuli_WQYk5sbgj7EHMfq4hnqiuj8b0A1MgY6OEE1Zci0tIAFNC1c7X5PuIrw Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 05aa2418cebe4625b97d8ef5baf70a35 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesActionsTest-412764957 Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:30:13.746878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/05aa2418cebe4625b97d8ef5baf70a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/05aa2418cebe4625b97d8ef5baf70a35"}]}] Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesActionsTest-412764957 Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 05aa2418cebe4625b97d8ef5baf70a35 Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesActionsTest-412764957 Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesActionsTest-412764957-project Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b1146abe4f9042968fd32a639cd504bc Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesActionsTest-412764957-project Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. Oct 11 13:30:13.748306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'e265cc3c-f312-428d-8c94-0a1becdbe95b'} Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:30:13.749028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. Oct 11 13:30:13.750158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:30:13.751280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] Returning 404 to user: Instance e265cc3c-f312-428d-8c94-0a1becdbe95b could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:30:13.751280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-03a21e6f-5fc2-42fd-9c95-6b427e9294e4 tempest-VolumesActionsTest-412764957 tempest-VolumesActionsTest-412764957-project] 10.222.0.15 "GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b" status: 404 len: 111 microversion: 2.1 time: 0.064219 Oct 11 13:30:13.751280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 190/374] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:13 2022] GET /compute/v2.1/servers/e265cc3c-f312-428d-8c94-0a1becdbe95b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:30:47.714696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:47.715651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:47.716424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2062793600", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "networks": [{"uuid": "059a7050-6e7e-4e2f-bd2d-1ed7ceb787a3"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:47.725393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:47.726548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:47.729303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:47.730276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:47.734837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:47.735849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:47.737042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:47.739642 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:47.742730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=17 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:47.743447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=46 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:47.750027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:30:47.750217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Tue Oct 11 13:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 11 13:30:47.758949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:30:47.759292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Tue Oct 11 13:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 11 13:30:47.796272 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-20d4ce99-b1e2-419c-b19a-926c5e292331 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/ips" status: 200 len: 151 microversion: 2.20 time: 0.090664 Oct 11 13:30:47.797029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 185/375] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Oct 11 13:30:47 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:30:47.815091 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] validate_networks() for [('059a7050-6e7e-4e2f-bd2d-1ed7ceb787a3', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:30:48.518931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:30:48.519263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:30:48.519729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:30:48.520148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:30:48.520890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:30:48.543983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:48.544930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:48.545414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:48.546321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:48.547140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:48.547715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:48.574708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Getting quotas for project 192799a3ba9a4c0e981f6813a0341768. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:30:48.579592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Getting quotas for user 71b6993791904a50a94ba0f980c9c0c6 and project 192799a3ba9a4c0e981f6813a0341768. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:30:48.593504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:30:48.597017 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:30:48.670407 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b5291681-e5d3-4f2d-b1fb-43d2346af049 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961200 Oct 11 13:30:48.671052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 191/376] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:30:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:30:48.683569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ae54c013-5c6a-4e7b-a5ba-20d957efd3c2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:48.686064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ae54c013-5c6a-4e7b-a5ba-20d957efd3c2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:48.797749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ae54c013-5c6a-4e7b-a5ba-20d957efd3c2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:48.807414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ae54c013-5c6a-4e7b-a5ba-20d957efd3c2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1219 microversion: 2.1 time: 0.127190 Oct 11 13:30:48.812321 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 186/377] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:48 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:49.832204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:49.833503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:49.841639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:49.842362 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:49.843026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:49.844327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:49.846104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:49.849436 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:49.960521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:49.978167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d3f6a693-a29d-4aac-9ed3-c820e53efa98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1271 microversion: 2.1 time: 0.147260 Oct 11 13:30:49.988430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 192/378] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:49 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:50.100185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:50.101000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:50.110177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:50.110670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:50.111355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:50.112246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:50.112908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:50.113777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:50.149510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lazy-loading 'flavor' on Instance uuid fe7af4bf-c080-41e5-8b2d-e0a639122ad1 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:30:50.602241 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0c780618-77c1-4963-bf44-9c75b3d4eab8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/action" status: 202 len: 0 microversion: 2.20 time: 0.510329 Oct 11 13:30:50.608253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 187/379] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 11 13:30:50 2022] POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:30:50.618978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:50.619632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:50.646477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:50.647355 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:50.648011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:50.651032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:50.652133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:50.653224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:51.017824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:51.019340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:51.030671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:51.041977 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:51.047636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:51.050592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:51.051535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:51.051735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:51.068996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:51.080837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:51.083339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:51.085223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d42dbe39-3e3c-471f-adf2-0e64e1a26d56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.477319 Oct 11 13:30:51.086314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 193/380] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:50 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:30:51.254424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:51.255335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:51.266245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:51.272531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:51.273360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:51.274327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:51.275042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:51.276879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:51.343552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6c59ae1e-1250-4a75-a162-e580d965c9d3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/ips" status: 200 len: 148 microversion: 2.1 time: 0.092019 Oct 11 13:30:51.343744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:51.345954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 194/381] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:30:51 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/ips => generated 148 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:30:51.364694 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fc59cb00-f8ae-4f43-982f-228c2e9d2f4f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1277 microversion: 2.1 time: 0.362104 Oct 11 13:30:51.372935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 188/382] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:51 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:52.112270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:52.113687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:52.121670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.122373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.123026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.123930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.124726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.125346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.396533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:52.397142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:52.406592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.409186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.409777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.412378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.413941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.414589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.569004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:52.578969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:52.584524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:52.585784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ec1eeaea-9146-40e9-9593-33f2bb86aef4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.478809 Oct 11 13:30:52.597971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 195/383] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:52 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:30:52.608300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:52.609035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:52.627916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.628379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.628821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.629531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:52.629987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:52.630415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:52.683623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-35fe3315-e0c2-4753-8ba5-073e4ba2b1c2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/ips" status: 200 len: 147 microversion: 2.1 time: 0.081493 Oct 11 13:30:52.685365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 196/384] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:30:52 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/ips => generated 147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:52.813630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:52.824524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-372e2d36-2149-4df1-9d2d-092d95084988 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.432211 Oct 11 13:30:52.825226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 189/385] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:52 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:53.233083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bfe919f-5946-47ce-ad2f-a995195afa3d"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:53.235625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:53.246815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.247314 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.247747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.248479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.248924 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.249341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.423879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952391a8-5c18-4380-9171-d53c53effc90", "tag": "56635b26-a391-4908-917c-b5b4cc32c9f7"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:53.457435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.462618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.467308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.500405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] Creating event network-changed:56635b26-a391-4908-917c-b5b4cc32c9f7 for instance 952391a8-5c18-4380-9171-d53c53effc90 on hv-cinder-85061 Oct 11 13:30:53.516741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-9c546c8e-5de5-42b3-9b97-1d70bcb44e2c req-2165e550-b1b5-4877-aae9-c6e0b1f4336f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097720 Oct 11 13:30:53.518537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 190/386] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:53.620486 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:53.621329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:53.636712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.637314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.639338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.642692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.644792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.646202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.835857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-aea0f687-0631-4ac2-8a2a-3018e4c83022 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606376 Oct 11 13:30:53.841187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 197/387] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:30:53 2022] POST /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:30:53.856858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:53.859506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:53.876776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.878044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.878758 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:53.880033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:53.881715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:53.882523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:54.163362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:54.185619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:54.187514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:54.189091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-45493b4d-ab25-413a-ad7b-0767e7ac957e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.575231 Oct 11 13:30:54.190122 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 191/388] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:53 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:30:54.291299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:54.299203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-094ec225-263f-4d70-aeed-e4aa63b71eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.454998 Oct 11 13:30:54.300092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 198/389] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:53 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:55.222507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:55.224286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:55.251569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362fe510-f5bd-4bb4-b023-5486adfab0b9"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:30:55.254632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:55.258106 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.264156 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.265263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.266019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.267134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.267598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.268014 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.272531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.273127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.273985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.274721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.275288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.461861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:55.471121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:55.472579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:55.473940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f4c402dc-c5aa-4aab-8fa2-e4893ba9766d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.258605 Oct 11 13:30:55.474647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 192/390] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:55 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:30:55.479616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:55.480453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:55.487246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.487932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.488625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.489468 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:55.490068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:55.490643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:55.668478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:55.678848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8c51c177-062e-423c-88af-d9be89a100a1 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.202510 Oct 11 13:30:55.679832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 193/391] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:55 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:56.499327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:56.499992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:56.507558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:56.508219 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:56.508662 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:56.509373 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:56.509827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:56.514682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:56.678623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:56.691748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:56.693222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:56.694415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-83caa810-4810-413c-b7e3-e9c5ec4184a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.199510 Oct 11 13:30:56.694958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 194/392] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:56 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:30:56.706742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:56.707759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:56.714516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:56.715171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:56.715782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:56.716498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:56.717068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:56.717806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:57.152331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:57.166619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b64be6af-08db-4fa6-b95d-e0b8e6d3006d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.463594 Oct 11 13:30:57.167728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 195/393] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:56 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:57.399845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-eb1f93e7-afd9-4120-ad42-25b9d1177747 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.153061 Oct 11 13:30:57.404166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 199/394] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:30:55 2022] POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments => generated 194 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:30:57.723407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:57.724093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:57.740427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:57.740911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:57.741343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:57.742039 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:57.747869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:57.748591 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:57.898593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:57.908029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:57.910091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:57.911331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-09897943-b209-4eb1-a86c-e393149ea4f0 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.193811 Oct 11 13:30:57.911859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 196/395] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:57 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:30:58.196260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:58.197389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:58.204202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:58.204688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:58.205298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:58.206206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:58.206914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:58.207499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:58.379739 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:58.392450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2036f26f-d1e3-4b8f-9f5f-85503ad033b6 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.201010 Oct 11 13:30:58.393328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 200/396] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:58 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:30:58.934438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:58.944846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:58.947263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:58.964960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:58.965799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:58.966480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:58.967266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:58.967797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:58.968360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:59.201496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:59.213436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:59.215289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:59.216727 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2514ec25-d18f-4b43-9775-505f2e513aa4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.283674 Oct 11 13:30:59.218004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 197/397] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:30:58 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:30:59.415815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:30:59.417403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:30:59.424144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:59.428608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:30:59.431184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:59.432239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:59.432945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:59.433881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:30:59.434545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:30:59.435190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:30:59.611837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:30:59.620891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cf2a6928-4adb-4784-b2c8-7848bc387e43 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.208752 Oct 11 13:30:59.623030 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 201/398] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:30:59 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:00.250270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:00.250900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:00.258370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:00.259229 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:00.259833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:00.260747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:00.261355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:00.261968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:00.428809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:00.456260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:00.461020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:00.464803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-af683b7a-0dc6-4ea1-9c3c-0f439248376b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.222691 Oct 11 13:31:00.481311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 198/399] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:00 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:00.645552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:00.646781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:00.661558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:00.662061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:00.662503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:00.663233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:00.663690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:00.664149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:00.790897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952391a8-5c18-4380-9171-d53c53effc90", "name": "network-vif-plugged", "status": "completed", "tag": "56635b26-a391-4908-917c-b5b4cc32c9f7"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:00.800613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:00.801094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:00.801777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:00.828006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] Creating event network-vif-plugged:56635b26-a391-4908-917c-b5b4cc32c9f7 for instance 952391a8-5c18-4380-9171-d53c53effc90 on hv-cinder-85061 Oct 11 13:31:00.837931 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-d18b7ac7-56d5-4e04-b32c-3aa651ef1d1b req-cb340834-deca-41aa-a1fc-b9455004aab6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048148 Oct 11 13:31:00.838791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 199/400] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:31:00.914276 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:00.923721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4b173833-7e56-4ebb-aff1-0c7a829c754a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.281898 Oct 11 13:31:00.924743 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 202/401] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:00 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:01.503278 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:01.504858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:01.511930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:01.512430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:01.513072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:01.513773 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:01.514382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:01.515073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:01.695574 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:01.704147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:01.705681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:01.707073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b79fcf0a-94bb-465c-8ce5-8b41d7adac09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.208603 Oct 11 13:31:01.708311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 200/402] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:01 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:01.946710 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:01.947367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:01.954673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:01.955219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:01.955780 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:01.956532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:01.956989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:01.957427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:02.100827 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:02.109289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a313a0d8-5266-4d25-82f9-241a168bcd98 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.166495 Oct 11 13:31:02.120674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 203/403] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:01 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:02.732811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:02.733412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:02.742703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:02.743460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:02.744060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:02.744938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:02.745564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:02.746141 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:02.928226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:02.941085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:02.943341 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:02.945072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fe8f607b-2ce4-42d0-973f-5be486d2f426 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.216208 Oct 11 13:31:02.948156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 201/404] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:02 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:03.132996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:03.135636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:03.147165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:03.147999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:03.150214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:03.151112 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:03.153374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:03.154038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:03.342230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:03.350442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d8fc3078-3324-4c5b-8a09-2e162b9a02d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1319 microversion: 2.1 time: 0.221790 Oct 11 13:31:03.351267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 204/405] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:03 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:03.971617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:03.972532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:03.980102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:03.980765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:03.981263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:03.982208 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:03.982778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:03.983251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:03.988167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:04.125020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:04.133423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:04.134938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:04.136245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-09015eec-f8c0-427e-b9ec-1132b5661680 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.168728 Oct 11 13:31:04.152140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 202/406] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:03 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:04.373281 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:04.373859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:04.380875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:04.381737 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:04.382333 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:04.383056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:04.383568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:04.384222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:04.541794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:04.555428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b765ca37-dc9e-4562-8080-a13b412fb7d4 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1508 microversion: 2.1 time: 0.185787 Oct 11 13:31:04.556874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 205/407] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:04 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:05.163416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:05.165208 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:05.174982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:05.175731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:05.176421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:05.201887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:05.202685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:05.203292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:05.207075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7fb998d5-2cc0-4698-982b-b33e9978e037 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: .version_select at 0x7f7a551ef940>, body: {"keypair": {"name": "tempest-keypair-258022483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRtjpbY7gOTW6L72LP1FUwC/sXXkxqdb+TeztwncXTT8yA4E4TqlpQXSxfBFZDRy2eD4LIR5b+6iQYOGsqEj9kIcnfaiU50scVP0ccyE0dQb6yI8SRBbqJZZfVZy+UaZA=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:05.237124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-7fb998d5-2cc0-4698-982b-b33e9978e037 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:31:05.242247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-7fb998d5-2cc0-4698-982b-b33e9978e037 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:31:05.280851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7fb998d5-2cc0-4698-982b-b33e9978e037 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078207 Oct 11 13:31:05.282573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 206/408] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:31:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:31:05.423127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:05.449631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:05.453223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:05.454597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dadaa6f4-7d9c-442b-9095-9ef4976e7212 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.296632 Oct 11 13:31:05.455243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 203/409] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:05 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:05.687024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-21cc204b-83a9-4967-b627-204afc49d2b3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'create', calling method: .version_select at 0x7f7a5547d160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1907073782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuWh7eXnysKFesQWnThXZTeLZQYjR2bdksIJaXvh9v7kDaa55pGpm257QaRI4qA4WxrbschXSHv5kAO7BVOcQc8vb7G1k9nrS9ZMhiLN4lsSBzjh86HHmR2T68mNx8clQ=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:05.706272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-21cc204b-83a9-4967-b627-204afc49d2b3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Getting quotas for project 07b1cc93b68340b787ee0c99f1bf7c68. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:31:05.710250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-21cc204b-83a9-4967-b627-204afc49d2b3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Getting quotas for user ee084e4a27a94d409653f36e786af9e7 and project 07b1cc93b68340b787ee0c99f1bf7c68. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:31:05.737940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-21cc204b-83a9-4967-b627-204afc49d2b3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055789 Oct 11 13:31:05.739435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 207/410] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:31:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:31:05.792409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-625710979", "imageRef": "d5a08d00-8fca-4054-a447-d46054e37298", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1907073782", "networks": [{"uuid": "60bcc454-4d0c-4b30-b611-9325cbb84f53"}]}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:05.847613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] validate_networks() for [('60bcc454-4d0c-4b30-b611-9325cbb84f53', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:31:06.239146 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:31:06.239762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:31:06.240036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:31:06.240500 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:31:06.240912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:31:06.250549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:06.251256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:06.251865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:06.252795 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:06.253434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:06.254026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:06.279240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Getting quotas for project 07b1cc93b68340b787ee0c99f1bf7c68. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:31:06.290328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Getting quotas for user ee084e4a27a94d409653f36e786af9e7 and project 07b1cc93b68340b787ee0c99f1bf7c68. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:31:06.301886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:31:06.304183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d5a08d00-8fca-4054-a447-d46054e37298',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:31:06.360252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fb10bbb1-7580-4bac-802e-d5b5f1cbd6db tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572046 Oct 11 13:31:06.361355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 204/411] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:31:06.372557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-33bf7f9a-1763-4106-ac89-5f3d72a461de tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:06.373529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-33bf7f9a-1763-4106-ac89-5f3d72a461de tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:06.434709 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33bf7f9a-1763-4106-ac89-5f3d72a461de tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:06.441853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-33bf7f9a-1763-4106-ac89-5f3d72a461de tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1258 microversion: 2.1 time: 0.073472 Oct 11 13:31:06.452744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 208/412] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:06 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:06.481646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:06.482420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:06.490673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:06.491166 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:06.491841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:06.492892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:06.493573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:06.494335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:06.658700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "name": "network-vif-plugged", "status": "completed", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:06.675856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:06.679007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:06.680937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:06.706561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:06.709514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:06.713252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] Creating event network-vif-plugged:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:31:06.726471 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-3f82210e-0147-4367-a08a-faefee51a7c0 req-7ef2871a-8ae0-482d-ae1c-5e2bf4f8a225 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072049 Oct 11 13:31:06.726921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:06.727517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 209/413] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:31:06.728714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:06.730151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9b26ce0c-4aa8-4621-a2e4-4800fefa01b3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.252779 Oct 11 13:31:06.731074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 205/414] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:06 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:06.779188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-318752316", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9ecb25f-434f-42aa-a99d-d1d2a47d24ff"}], "security_groups": [{"name": "tempest-securitygroup--1810607957"}], "key_name": "tempest-keypair-258022483", "user_data": "}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:06.888825 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] validate_networks() for [('f9ecb25f-434f-42aa-a99d-d1d2a47d24ff', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:31:07.285075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:31:07.285645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:31:07.286107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:31:07.286510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:31:07.286919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:31:07.296322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.296801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.297353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.298130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.298583 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.299215 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.317986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:31:07.321992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:31:07.333145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:31:07.335575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:31:07.396323 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a88245e6-a32c-4a2f-903d-4e92e3d66b80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622074 Oct 11 13:31:07.403575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 210/415] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:31:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:31:07.409144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-21167dd8-657d-45da-84db-91891840a35e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:07.410225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-21167dd8-657d-45da-84db-91891840a35e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:07.476267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:07.477003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:07.485629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.485629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.487784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-21167dd8-657d-45da-84db-91891840a35e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:07.490382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.491630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.495001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.495653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.495785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-21167dd8-657d-45da-84db-91891840a35e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1240 microversion: 2.1 time: 0.090461 Oct 11 13:31:07.500342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 206/416] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:07 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:07.567078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:07.573646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-14450eeb-99a5-41f4-9c8d-ab4c4a1242f8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1310 microversion: 2.1 time: 0.102631 Oct 11 13:31:07.574298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 211/417] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:07 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:07.757072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:07.757819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:07.763966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.764512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.764927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.765948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:07.766398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:07.766889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:07.915550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:07.925187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:07.927317 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:07.929075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e19c829b-7bc9-40fa-9c0d-ea5b757a5f1d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.176949 Oct 11 13:31:07.930378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 207/418] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:07 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:08.522794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:08.524957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:08.538402 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.538958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.539397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:08.540164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.540627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.541046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:08.599351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:08.600865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:08.612016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.613207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.613838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:08.614849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.615548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.616196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:08.696593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:08.727979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-646b248d-4d9c-46fd-9aa1-84a3f7ed0d3c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.209210 Oct 11 13:31:08.728915 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 212/419] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:08 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:08.893120 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:08.907795 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8445f285-c83b-48c2-b50c-d2f8cd67dea6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.313801 Oct 11 13:31:08.908449 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 208/420] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:08 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:08.954731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:08.955352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:08.966233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.966721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.967153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:08.967884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:08.968380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:08.968798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:09.152439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:09.161475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:09.162917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:09.164080 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cfaee8e7-78fd-4f62-afa1-9fd0704db228 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.214164 Oct 11 13:31:09.164671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 213/421] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:08 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:09.759034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:09.759639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:09.767663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:09.768432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:09.768886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:09.769597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:09.770216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:09.770682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:09.843405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:09.851101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-68a4e9ad-9c2c-4a62-a5f4-9151e8e689a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.096086 Oct 11 13:31:09.851663 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 209/422] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:09 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:09.936499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:09.938014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:09.942063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:09.950341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:09.950840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:09.951283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:09.952058 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:09.952545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:09.952970 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:10.095544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:10.103609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-670aa858-65fb-4320-ab3b-f4332f4db626 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.171059 Oct 11 13:31:10.104419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 214/423] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:09 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:10.191827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:10.192459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:10.199178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:10.199652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:10.200076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:10.200826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:10.201282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:10.201708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:10.342246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:10.353286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:10.353739 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:10.355292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bca0c208-2f31-4c8a-aadb-712c18cf349a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.167674 Oct 11 13:31:10.356414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 210/424] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:10 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:10.876443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:10.877075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:10.883834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:10.884370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:10.884807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:10.885511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:10.885969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:10.886386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:10.958232 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:10.966031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-36dec2f8-d3d3-41a9-bca8-41f33a5eaab9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.093899 Oct 11 13:31:10.966595 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 215/425] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:10 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:11.127401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:11.128666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:11.136529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.137017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:11.137443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:11.138134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.138588 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:11.139005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:11.277793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:11.286421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-62b12953-b483-4170-9859-fb5f0a915caf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.163385 Oct 11 13:31:11.287188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 211/426] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:11 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:11.381554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:11.382452 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:11.389057 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.389574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:11.390009 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:11.391007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.391453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:11.392104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:11.529686 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:11.538145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:11.539583 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:11.540778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8714f717-9163-41d7-88af-3d6b7496571e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.163367 Oct 11 13:31:11.541574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 216/427] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:11 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:11.989838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:11.990447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:11.997486 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.998037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:11.998528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:11.999222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:11.999679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:12.000109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:12.070722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:12.079572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-347ec716-b2c9-4185-90ac-c92103dc6d2b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.093481 Oct 11 13:31:12.080184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 212/428] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:11 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:12.310695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:12.311274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:12.318251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:12.318730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:12.319166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:12.319868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:12.320357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:12.320769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:12.457094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:12.465802 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e00b1d3b-4a01-4115-8955-000b568a3988 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.159050 Oct 11 13:31:12.466624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 217/429] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:12 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:12.567076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:12.567689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:12.574516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:12.575302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:12.575717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:12.576479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:12.577150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:12.577560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:12.725869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:12.737158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:12.738864 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:12.740276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-59879f9d-0bd2-488a-a48d-a6b4357f51a3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.177538 Oct 11 13:31:12.740918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 213/430] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:12 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:13.103112 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:13.105521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:13.112917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.113716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.114209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.114939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.115482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.115948 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.184577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:13.192655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b17063d3-6084-4beb-8f01-0a00d99baaec tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.093567 Oct 11 13:31:13.193227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 218/431] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:13 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:13.492793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:13.494252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:13.507552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.508842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.509520 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.510637 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.511334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.511982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.663005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:13.670996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a6b4c512-c62c-4fb8-8248-7527e353c408 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.185149 Oct 11 13:31:13.671579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 214/432] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:13 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:13.766950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:13.768683 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:13.779523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.780358 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.781067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.781965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:13.782414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:13.783003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:13.951577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:13.960937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:13.962728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:13.964431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5ca2735f-c9b4-46e9-b2b2-0f707feb3f93 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.202005 Oct 11 13:31:13.965265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 219/433] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:13 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:14.228897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:14.229570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:14.236302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:14.236789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:14.237222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:14.237976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:14.238427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:14.238850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:14.308004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:14.316545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-937b0056-7b2b-4b74-bbdc-7551e886225f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.103379 Oct 11 13:31:14.317267 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 215/434] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:14 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:14.694878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:14.695525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:14.701736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:14.702316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:14.702751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:14.703437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:14.703890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:14.704336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:14.847335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:14.855548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1dfed235-812a-49f2-884d-b453029fdc51 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.164536 Oct 11 13:31:14.856150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 220/435] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:14 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:14.991672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:14.992328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:15.000009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.000530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.001223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:15.001993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.002518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.003010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:15.149337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:15.157566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:15.159006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:15.160184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fb4cb560-61f0-456e-bebc-fbf2da63f676 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.172494 Oct 11 13:31:15.160741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 216/436] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:14 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:15.340393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:15.341332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:15.358546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.360918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.361437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:15.362330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.362852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.363345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:15.432982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:15.440773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-03aa34ee-7d7f-42c4-9833-fafc5d10aaa9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.104515 Oct 11 13:31:15.441332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 221/437] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:15 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:15.881440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:15.881666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:15.892708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.893186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.893619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:15.894687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:15.895150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:15.895592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:16.069227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:16.080363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-14df50d1-20d3-41ee-82b4-227c15d33671 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.202880 Oct 11 13:31:16.081295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 217/438] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:15 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:16.185669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:16.186416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:16.193211 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:16.193770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:16.194287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:16.195055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:16.195582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:16.196084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:16.329660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:16.338424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:16.339870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:16.341105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-32710d25-5722-478b-b3a8-3e44684c93fb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.159363 Oct 11 13:31:16.341631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 222/439] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:16 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:16.463540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:16.464366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:16.466347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:16.472664 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:16.473204 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:16.473747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:16.474685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:16.475215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:16.475710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:16.545797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:16.554195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-875564ac-490c-46fd-8f2d-def706d07afe tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.094668 Oct 11 13:31:16.554957 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 218/440] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:16 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:17.105187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:17.105763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:17.112243 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.112830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.113243 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.114029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.114397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.114842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.246762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:17.254784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1a72fa3b-6605-4268-a2ef-1f5e02887868 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.154376 Oct 11 13:31:17.265397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 223/441] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:17 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:17.367150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:17.367742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:17.373944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.374417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.375031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.375757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.376243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.376900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.493254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=8 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:17.518692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:17.527526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:17.529006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:17.530293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c125c52d-7cb7-40c9-87ba-51e83579344f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.167134 Oct 11 13:31:17.530856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 219/442] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:17 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:17.576676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:17.577268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:17.579191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:17.579828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=16 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:17.585519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.586299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.586979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.587947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:17.588621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:17.589246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:17.668943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:17.677526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-567a99cb-4f58-4668-8851-8940d7f4a4cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.104830 Oct 11 13:31:17.678088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 224/443] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:17 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:18.279586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:18.280690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:18.282564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:18.288607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.289320 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.289759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.290451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.290892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.291310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.311192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:18.425446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:18.434794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bb719fa6-4aff-41b4-abf0-2435582934be tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.159659 Oct 11 13:31:18.435632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 220/444] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:18 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:18.557164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:18.557736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:18.564543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.565055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.565489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.566170 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.566639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.567066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.700471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:18.701177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:18.704483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:18.710463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.710463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.710463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.710463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:18.710929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:18.711072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:18.717365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:18.719346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:18.720900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6d6c2570-daa6-4726-8166-8f2b8c6d322f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.167916 Oct 11 13:31:18.721665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 225/445] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:18 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:18.799943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:18.808550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e611b6fe-3edc-461f-9500-cd5649dbed14 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.111858 Oct 11 13:31:18.809080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 221/446] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:18 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:19.457866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:19.458472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:19.464794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.465274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.465699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.466375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.466823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.467268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.600993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:19.608641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-328e998e-62ce-4ee9-a54f-a42d42f8db0b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.154607 Oct 11 13:31:19.609340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 226/447] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:19 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:19.751399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:19.751998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:19.759184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.759692 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.760150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.760920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.761394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.761838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.832271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:19.833017 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:19.839534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.840023 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.840493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.841199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:19.841661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:19.842209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:19.846625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:19.924153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:19.930533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:19.933865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0d5be758-a7fa-45c5-bed7-656705af3e13 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.105232 Oct 11 13:31:19.934893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 227/448] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:19 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:19.940653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:19.942134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:19.943301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fd6783a7-8a17-4e1a-8703-f7718ca5c792 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.197417 Oct 11 13:31:19.948178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 222/449] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:19 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:20.637618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:20.638668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:20.649821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.650620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.651347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:20.652563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.653325 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.654032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:20.791389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:20.799140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-af917b37-16f9-43cc-9c42-b30954e5e568 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.168422 Oct 11 13:31:20.799715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 228/450] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:20 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:20.961798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:20.962754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:20.972920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:20.973441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.973962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:20.974215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.974938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:20.976075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.976880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.977587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:20.983523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.984005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.984476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:20.985165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:20.985621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:20.986042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:21.049251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:21.057412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e623cbca-5e60-4f28-9edc-33c581d19b4f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.102043 Oct 11 13:31:21.058003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 223/451] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:20 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:21.141132 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:21.149491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:21.150925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:21.152076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f8f659dd-d2e8-47bb-ab4c-48c668b772aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.185619 Oct 11 13:31:21.152658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 229/452] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:20 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:21.826197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:21.827231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:21.834165 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:21.834684 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:21.835121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:21.835797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:21.836324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:21.836752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:21.968687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:21.981518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-20ac6700-8c6b-4ec9-b4d8-8ae3c9018139 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.161523 Oct 11 13:31:21.982439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 224/453] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:21 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:22.082444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:22.083074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:22.090440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:22.090961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:22.091421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:22.092170 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:22.092681 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:22.093137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:22.159991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:22.167863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dcdcfd9a-ecd5-4133-88eb-8346b4bdbef6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.089765 Oct 11 13:31:22.168393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 230/454] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:22 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:22.178114 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:22.178713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:22.184633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:22.185113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:22.185538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:22.186215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:22.186661 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:22.187074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:22.326183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:22.334471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:22.336006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:22.337279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-49a4daa6-3e5b-416d-b122-8ec0f08efd5e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.163148 Oct 11 13:31:22.337905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 225/455] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:22 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:23.009745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:23.010733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:23.021552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.022343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.023062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.024313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.025062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.025760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.159675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:23.170682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-583ea2aa-c65b-47e8-972c-50dc590d0a78 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.167237 Oct 11 13:31:23.171488 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 231/456] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:23 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:23.191537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:23.192284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:23.199067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.199586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.200024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.200749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.201203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.201631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.263277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:23.271787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-029beff4-c8e8-42a6-a90c-845a474c9bd7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.084246 Oct 11 13:31:23.272480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 226/457] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:23 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:23.367051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:23.368349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:23.377194 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.379047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.379726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.380474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:23.380936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:23.381350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:23.516877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:23.525259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:23.526692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:23.527845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c29137ff-289e-4320-95ee-97c96c68780a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.167879 Oct 11 13:31:23.528510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 232/458] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:23 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:24.202944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:24.203967 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:24.214810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.215614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.216409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.217510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.218311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.219005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.294927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:24.295516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:24.301834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.302322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.302754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.303449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.303901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.304361 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.380656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:24.384544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:24.388633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-10f32c51-fcd5-4633-8d20-53e0f0af91a6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.097460 Oct 11 13:31:24.389461 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 233/459] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:24 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:24.392974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fe43420f-369d-46f3-b71f-77fa92782a1f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.196541 Oct 11 13:31:24.393524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 227/460] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:24 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:24.560207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:24.561760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:24.572633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.573127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.573560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.574304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:24.574761 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:24.575174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:24.713381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:24.727120 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:24.729618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:24.731507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4f964830-09fe-41a6-9f3c-c1783b1bd6c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.180490 Oct 11 13:31:24.732457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 234/461] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:24 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:25.414972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:25.416008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:25.418920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:25.419958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:25.425284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.425782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.426237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.426915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.427054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.427375 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.427526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.427778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.427880 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.428498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.428958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.429367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.510171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:25.518279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9c3e97bc-7b00-4f9d-9e1a-22f3b0d9ea60 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.109801 Oct 11 13:31:25.525493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 228/462] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:25 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:25.591564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:25.599707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-73f13ecd-b3db-4890-acdf-c206bb6bdf52 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.187512 Oct 11 13:31:25.600392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 235/463] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:25 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:25.762434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:25.763304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:25.773687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.774484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.775204 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.776380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:25.777128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:25.777832 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:25.915766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:25.927703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:25.929819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:25.931558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b225d115-aa7f-4682-b3be-47198bab8a8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.175521 Oct 11 13:31:25.932376 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 229/464] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:25 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:26.540972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:26.541577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:26.547775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.548292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.548724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:26.549408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.549856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.550252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:26.615394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:26.623178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:26.623676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dc829a48-d45d-4ce8-9ef2-734cefc68449 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.086517 Oct 11 13:31:26.623933 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:26.624217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 236/465] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:26 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:26.630793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.631271 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.631720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:26.632435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.632918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.633349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:26.767701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:26.775676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-87e0fa27-3112-45fc-ae0f-8921298b9118 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.156549 Oct 11 13:31:26.776280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 230/466] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:26 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:26.963124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:26.964158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:26.972569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.973051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.973484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:26.974175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:26.974627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:26.975051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:27.107640 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:27.117388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:27.118825 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:27.119978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-929ea546-a5c3-46b0-a4e0-438ee348d5f6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.163424 Oct 11 13:31:27.120576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 237/467] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:26 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:27.648733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:27.650089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:27.657624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:27.658169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:27.658681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:27.659532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:27.659981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:27.660431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:27.730712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:27.738830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-74e19eaf-2c7f-4fc7-a2cc-505ab9b347f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.095986 Oct 11 13:31:27.739404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 231/468] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:27 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:27.798658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:27.799228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:27.806257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:27.806735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:27.807162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:27.807846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:27.808336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:27.808751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:27.949321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:27.958726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9aeb2f80-f00a-475a-9dd0-422964a7b4a6 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.163862 Oct 11 13:31:27.959291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 238/469] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:27 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:28.145946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:28.146540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:28.153579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:28.154107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:28.154583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:28.155370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:28.155866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:28.156378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:28.295022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:28.308367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:28.310562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:28.312364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0de4a6b6-4d0b-43d7-a2d3-1b34eea16bf6 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.170670 Oct 11 13:31:28.313649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 232/470] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:28 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:28.767286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:28.767992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:28.774125 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:28.774607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:28.775094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:28.775869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:28.776438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:28.776863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:28.838605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:28.846602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3ee98efa-70d8-4827-b3a4-70bcdb4c3505 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.084418 Oct 11 13:31:28.847124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 239/471] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:28 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:28.985339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:28.986374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:28.997328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:28.998185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:28.998931 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.000029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:29.000837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:29.001579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.149962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:29.158168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c8631eed-fb54-4ee1-814b-2f58190f4b92 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.179201 Oct 11 13:31:29.158725 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 233/472] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:28 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:29.342250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:29.343220 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:29.353224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:29.354007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:29.354719 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.355840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:29.356625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:29.357322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.489713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:29.502073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:29.503965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:29.505755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9387c2ee-c33c-45f0-9b9b-68c895792e99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.169687 Oct 11 13:31:29.506529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 240/473] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:29 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:29.878301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:29.879047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:29.886498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:29.887079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:29.887594 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.888454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:29.888986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:29.889503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:29.963031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:29.971788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-94089fe1-11bd-4197-8a9b-11afebb409e0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.100140 Oct 11 13:31:29.972417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 234/474] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:29 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:30.180741 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:30.181318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:30.187969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:30.188490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:30.188898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:30.189626 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:30.190072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:30.190491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:30.323089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:30.331152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-98128abb-14f0-4444-b354-d4cb1bed7b29 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.154233 Oct 11 13:31:30.331727 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 241/475] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:30 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:30.536025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:30.536710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:30.544386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:30.544925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:30.545416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:30.546179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:30.546687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:30.547192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:30.682691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:30.693987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:30.695454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:30.696684 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d0216f60-38ec-4c3d-9e0a-8c3b5c3f5248 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1744 microversion: 2.20 time: 0.166726 Oct 11 13:31:30.697282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 235/476] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:30 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:30.998886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:30.999960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:31.010360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.011252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.011982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.013185 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.013957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.014758 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.081690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:31.089579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-10b35eb5-a0e6-4eaa-8614-f9eade6a5597 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1292 microversion: 2.1 time: 0.097217 Oct 11 13:31:31.090161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 242/477] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:30 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:31.358413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:31.359331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:31.369849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.370656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.371363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.372557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.373306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.374003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.721863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:31.722634 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:31.727808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:31.734376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.741621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.742224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.743032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:31.745339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-073af24d-8963-461f-8011-7b3330f4843f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.393652 Oct 11 13:31:31.745896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:31.752244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 236/478] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:31 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:31.752759 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:31.892074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:31.896439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:31.903011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:31.904485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:31.905840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f057bdf7-9ac8-4801-9e26-b999d0941d09 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.188038 Oct 11 13:31:31.906378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 243/479] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:31 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:32.112428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:32.113175 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:32.119653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.120195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.120610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.121305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.121743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.122177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.126271 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:32.146003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:32.157158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.157627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.158207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.170389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] Creating event network-changed:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:31:32.175707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-269253c8-5843-4ec8-a696-367b2e5076cf req-e68e4ec0-fed8-40ee-a63c-bc982998685f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 Oct 11 13:31:32.176477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 244/480] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:31:32.191071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:32.198761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-661a2489-2cce-487c-9941-4729eb9da660 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1300 microversion: 2.1 time: 0.090324 Oct 11 13:31:32.199336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 237/481] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:32 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:32.777650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:32.778665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:32.788833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.789313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.789740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.790428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.790871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.791289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.930176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:32.933843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:32.934447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:32.937985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-21526a52-1f79-4e4f-a0cd-6904a284ec93 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.167629 Oct 11 13:31:32.938563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 245/482] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:32 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:32.941410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.942047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.942469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.943167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:32.943616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:32.944035 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:32.982256 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07413a9d-a31e-4a1d-9f78-61016abacb07", "device": "/dev/sdb"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:32.986056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:33.002081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.002313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.002677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:33.003460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.003999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.008641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:33.128356 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:33.142696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:33.146691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:33.148433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5fb9c613-1a14-4d4f-9c7f-1611ec3b7d7b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.218118 Oct 11 13:31:33.156217 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 238/483] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:32 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:33.221628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:33.222388 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:33.229436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.230546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.231349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:33.232463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.233674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.234827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:33.320081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:33.330523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5da5aee2-b9e3-4797-8d29-b5a019b3e13d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1298 microversion: 2.1 time: 0.112760 Oct 11 13:31:33.331882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 239/484] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:33 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:33.428763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-aafe8021-219e-41d8-9dfd-77d8393554cb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "POST /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450224 Oct 11 13:31:33.430164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 246/485] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:31:32 2022] POST /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:31:33.963135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:33.964679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:33.977704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.981763 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.982685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:33.984740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:33.986841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:33.987345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.181400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:34.182729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:34.191411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.192163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.192781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.193642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.194251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.194826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.279006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.290240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9c9d6d50-3aea-4b9a-bf5d-266259c21057 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.331953 Oct 11 13:31:34.308966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 240/486] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:33 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:34.314063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:34.326737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.327456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.328062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.378431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.390680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.393356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.394993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-884ca761-5ed0-47ac-81a8-4d8ccd6546fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.223958 Oct 11 13:31:34.409086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 247/487] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:34 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:34.417185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Going to try to stop instance {{(pid=118881) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 13:31:34.421860 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:34.422716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:34.429524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.430240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.430852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.431728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.432372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.432999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.494848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9536f4b0-cc48-414b-bef9-64531ddcac0c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action" status: 202 len: 0 microversion: 2.1 time: 0.184161 Oct 11 13:31:34.495833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 241/488] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:31:34 2022] POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:31:34.500782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.509367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9fbe4ed7-94c3-41f5-bec0-0479e089d870 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1298 microversion: 2.1 time: 0.098872 Oct 11 13:31:34.510216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 248/489] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:34 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:34.515990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:34.521082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:34.530629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.531425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.532063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.532968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:34.533596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:34.534191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:34.709722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:34.719302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-50506b6e-3e0e-44a9-89dc-bb6bc43cc0b3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.218306 Oct 11 13:31:34.720183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 242/490] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:34 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:35.316162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:35.317612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:35.324555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.325312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.326033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.326886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.327487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.328060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.427163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:35.428318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:35.438105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.443655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.444364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.445359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.445968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.446558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.592986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:35.603664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-73303e5e-370f-4ef2-838c-3a28ca64f461 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.291693 Oct 11 13:31:35.604551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 249/491] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:35 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:35.623528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:35.624424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:35.638641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.642417 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.643094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.644045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.645638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.646963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.735438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:35.745157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:35.750791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:35.752019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c77dcf44-d281-4f20-ab67-167070445dbd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.330938 Oct 11 13:31:35.771907 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 243/492] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:35 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:35.785618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:35.786422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:35.801499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.801848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.802278 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.807074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:35.807761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:35.808695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:35.945011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:35.956931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4d86ff81-0205-49b0-9ca8-7a28fb0ea273 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.351113 Oct 11 13:31:35.957717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 250/493] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:35 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:36.062969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:36.078156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7a52af4e-3a5c-4201-b595-aea01cab1df3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.304679 Oct 11 13:31:36.079448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 244/494] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:35 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:36.241393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16d3793-e4d8-4a6b-8cba-9e0e20d70722", "tag": "1112479d-152b-4660-a6ed-8584f3470465"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:36.254055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.260819 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.261504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.290625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] Creating event network-changed:1112479d-152b-4660-a6ed-8584f3470465 for instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 on hv-cinder-85061 Oct 11 13:31:36.297277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-7e719b89-abd4-4186-8a6e-285af419ed0f req-4833d903-23dd-4028-b8b6-f8039eddf74f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059743 Oct 11 13:31:36.298713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 251/495] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:31:36.634305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:36.634924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:36.644898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.645375 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.645809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.646497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.646945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.647365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.793310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:36.796729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:36.798103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:36.805448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fbfc0b86-33f5-43fb-aafb-ec500a28eab7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.181615 Oct 11 13:31:36.821165 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 245/496] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:36 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:36.821440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.821440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.821440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.821440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.821796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.821796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.978756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:36.981770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:36.982377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:36.989641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.990126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:36.990286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.990551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.991249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:36.991694 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:36.991882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:36.992144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:36.993082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2e13a373-36ef-4a6d-98f0-9871a9c24cb7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.201662 Oct 11 13:31:36.993956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 252/497] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:36 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:37.106900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:37.107507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:37.114851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:37.115178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:37.116380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:37.117401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:37.118186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:37.118908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:37.149425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:37.159151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a753ff93-2669-4529-a784-6245d8277b2a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.181209 Oct 11 13:31:37.174807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 246/498] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:36 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:37.269313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:37.278092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-241a08fe-9a20-4fc1-99dd-d05862269d00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.177177 Oct 11 13:31:37.278997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 253/499] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:37 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:37.855334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:37.857668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:37.872359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:37.872950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:37.873464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:37.874245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:37.874775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:37.875207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.022371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:38.022996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:38.030861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.031387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.032769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.034407 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.034878 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.035311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.046906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.054888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dc3c125c-990b-47a4-8515-0b7684b5437d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.203615 Oct 11 13:31:38.055677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 247/500] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:37 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:38.184704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:38.185718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:38.186476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.194579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.195294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.195833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.195993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.196882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.197324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.197475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.197948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.198940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a80dba4d-c112-49c4-9fe7-bd925d0d00c2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.180570 Oct 11 13:31:38.208885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 254/501] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:38 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:38.302688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:38.303375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:38.309940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.310474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.311233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.311930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:38.312302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:38.313122 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:38.407022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.415616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9fb7f154-80b1-4244-8dbf-22b8c3cfeed8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.236426 Oct 11 13:31:38.417536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 248/502] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:38 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:38.473108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:38.481742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4c204881-57f8-44ed-8ca8-1055344c0e8c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.183230 Oct 11 13:31:38.482523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 255/503] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:38 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:39.078736 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:39.079981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:39.087784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.088306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.088918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.089610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.090060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.090477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.225580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:39.226960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:39.233811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.234530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.234965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.235662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.236139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.236714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.263667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.272708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c96d1d80-d53b-4bdd-9170-f4ee3cd028a8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.198424 Oct 11 13:31:39.273280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 249/504] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:39 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:39.410077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.425812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.427673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.429221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d6dddc80-14fe-4a1e-b1d8-e0f7285db135 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.207542 Oct 11 13:31:39.429794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 256/505] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:39 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:39.451179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:39.452196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:39.459434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.460224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.460868 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.461755 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.462360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.462943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.505588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:39.506301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:39.512854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.513620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.514241 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.515477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:39.516083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:39.516692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:39.715191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.717995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:39.726109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bf452720-8651-415e-90d9-f2838b12e97b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.285450 Oct 11 13:31:39.726757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 250/506] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:39 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:39.734872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-db67f34c-0dbd-401c-ae18-c3363b38b8e1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.233235 Oct 11 13:31:39.735443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 257/507] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:39 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:40.316206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:40.317498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:40.327693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.329673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.330982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.331869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.332749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.333509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.457852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:40.458912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:40.462632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=87 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:40.468347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.469066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.469647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.470505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.471113 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.471805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.621875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:40.643785 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8eeb2120-e4a4-407f-9369-50422c1b2d65 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.347745 Oct 11 13:31:40.644665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 251/508] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:40 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:40.705360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:40.714833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:40.718753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:40.720195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5cc78e28-927b-47bb-b78a-2c3ed9cb8485 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.269870 Oct 11 13:31:40.733038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 258/509] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:40 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:40.751618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:40.752377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:40.763036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.763819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.764640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.765776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:40.766667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:40.766911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.767530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.768152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.781740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.782390 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.784429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:40.787154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:40.788159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:40.788866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:41.017835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.019705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.023268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:41.029874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7686ae67-34aa-4b99-94fa-3a8337cfb580 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.284819 Oct 11 13:31:41.030186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-97b7729f-bff7-4335-aacc-415ebb5e4c04 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.272705 Oct 11 13:31:41.030466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 252/510] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:40 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:41.031389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 259/511] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:40 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:41.675418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:41.675938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:41.684281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:41.685036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:41.685644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:41.686518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:41.687135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:41.687561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:41.746864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:41.747734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:41.759127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:41.759872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:41.760498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:41.761383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:41.761832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:41.762253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:41.799015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:41.881226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.890472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c2bcecfc-8692-454c-a1f4-c98a997d85f3 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.219380 Oct 11 13:31:41.905456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 253/512] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:41 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:41.980566 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.989068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.991003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:41.992508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0dd7bc3d-7b90-4b6c-993c-fcda96f98dfa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.249453 Oct 11 13:31:41.993283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 260/513] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:41 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:42.053508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:42.054124 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:42.056768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:42.058972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:42.060418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.060887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.061423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:42.062136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.062658 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.063093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:42.069732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.070218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.071327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:42.071459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.071806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.072251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:42.280841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:42.286280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:42.289791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-edf7459c-f3a3-4004-9cd9-d21e2e9ed096 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.238834 Oct 11 13:31:42.294109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ada20da5-76aa-4dd0-9c12-03c6f10b45b7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.244924 Oct 11 13:31:42.298110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 254/514] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:42 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:42.306742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 261/515] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:42 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:42.915492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:42.916137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:42.924533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.925176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.925604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:42.926292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:42.926738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:42.927156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.020525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:43.022886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:43.033317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.034187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.034973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.036099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.036754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.037352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.076292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.084821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-eefbbd24-276d-42d9-a624-8405065fa79b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.173557 Oct 11 13:31:43.100829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 255/516] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:42 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:43.212578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.221675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.223178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.224416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2521c426-81b1-4a11-926c-0a42579b1407 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.209643 Oct 11 13:31:43.225419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 262/517] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:43 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:43.314375 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:43.314987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:43.321237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:43.321855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:43.329024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.329584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.330067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.330176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.330628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.331119 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.331239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.331748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.331854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:43.332305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.332441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:43.332734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:43.535831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.541806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:43.544802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4a3fae64-8a3b-483d-8dc8-a403708ffc7c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.234333 Oct 11 13:31:43.549805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-910d06c5-9618-4c71-83b8-2b6b740a5a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.232415 Oct 11 13:31:43.550342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 263/518] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:43 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:43.556456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 256/519] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:43 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:44.116669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:44.118511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:44.130563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.131045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.131473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.132152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.132630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.133048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.250283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:44.250993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:44.257839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.258316 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.258749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.259445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.259857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.260358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.271205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.278940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c588f442-5f18-4359-84f5-676d20c2621b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.172614 Oct 11 13:31:44.279504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 264/520] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:44 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:44.388739 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.397497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.398913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.400093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fce0f763-045f-4b84-8db2-0b764ee7c699 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.153955 Oct 11 13:31:44.400652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 257/521] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:44 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:44.572658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:44.573900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:44.580659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:44.581615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:44.583673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.584343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.589518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.589518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.589518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.589518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.589920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.589920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.589920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.590278 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:44.590897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:44.592174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:44.780216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.783386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:44.788782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5fd7e481-250e-4743-b679-02a142fef542 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.222510 Oct 11 13:31:44.789573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 265/522] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:44 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:44.791285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-237445ad-8f7d-4ac6-a07b-59f049e12596 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.220939 Oct 11 13:31:44.791848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 258/523] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:44 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:45.305242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:45.306349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:45.317184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.318027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.318756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.319918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.320821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.321531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.434587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:45.435320 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:45.442478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.443051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.443552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.444373 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.444886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.445380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.459843 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:45.467791 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0181e7a5-891d-44a8-95a8-88dc23ee7ec5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.169255 Oct 11 13:31:45.468389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 266/524] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:45 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:45.576181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:45.588478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:45.590376 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:45.591624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-76142b36-3436-42a1-92a1-3b35e04deee5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.161010 Oct 11 13:31:45.593843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 259/525] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:45 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:45.815230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:45.816264 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:45.816794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:45.817848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:45.826239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.826931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.827643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.827831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.828676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.828867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.829537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.829811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.830242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:45.830630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:45.831337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:45.831749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:46.024992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.028696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.033940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e4cdbdd2-9b81-4c60-a8e0-b94bae7ee5f0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.225131 Oct 11 13:31:46.034542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 267/526] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:45 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:46.036770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f80185ed-7b70-41d4-a7a3-ded4262628da tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.226295 Oct 11 13:31:46.037405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 260/527] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:45 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:46.495259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:46.496252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:46.505609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:46.506094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:46.506528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:46.507250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:46.507704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:46.508149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:46.616976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:46.617742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:46.624413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:46.624982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:46.625478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:46.626461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:46.626899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:46.627416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:46.639316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.650044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-544c1659-9dda-4938-8820-e92109dccd08 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.161350 Oct 11 13:31:46.650614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 268/528] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:46 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:46.767393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.776134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.777583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:46.778767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7adc2b83-cd13-47f1-ab67-5ab6501ad364 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.165758 Oct 11 13:31:46.779329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 261/529] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:46 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:47.057421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:47.058027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:47.064261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.064997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.065450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.066238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:47.066359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.066700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.067129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.067354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:47.073406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.073895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.074334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.075039 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.075484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.075905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.270976 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.273536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.279381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0b60d0aa-b939-4515-9565-15a4a72a2f00 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.225774 Oct 11 13:31:47.279996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 269/530] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:47 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:47.281251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-946c55de-a80d-42b0-b8f8-011de0745ec8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.219345 Oct 11 13:31:47.295382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 262/531] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:47 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:47.295575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "name": "network-vif-plugged", "status": "completed", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:31:47.295575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.295575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.295575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.306675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] Creating event network-vif-plugged:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:31:47.311906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-81c9f57e-837a-42ab-bb16-4de687adb8b2 req-b970b0dc-fac5-4576-8942-fde3ef709fdd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030721 Oct 11 13:31:47.312541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 270/532] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:31:47.673363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:47.674109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:47.682103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.682669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.683181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.684009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.684586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.685090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.812852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:47.813837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:47.820673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.821160 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.821589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.821744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.822687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:47.823299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:47.824051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:47.831347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ada8e4b3-b814-4e88-8a9f-e5d235efc355 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.162441 Oct 11 13:31:47.848960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 263/533] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:47 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:47.973673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.982364 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.983797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:47.985203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0c2c12fb-2834-42f8-8cc7-d3b6cb7eb094 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.177431 Oct 11 13:31:47.985778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 271/534] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:47 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:48.306929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:48.307929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:48.308801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:48.309865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:48.311038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=88 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:48.319458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.320338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.320551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.321039 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:48.321359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.322123 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:48.322284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.322911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.323250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.323614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:48.324032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.324776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:48.518036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:48.521087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:48.527137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-863d61bd-8d76-44c4-b58a-2f4a73a0423d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.226605 Oct 11 13:31:48.527693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 264/535] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:48 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:48.529661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7ebacae8-c3a0-4141-8bca-87deb616e628 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.227000 Oct 11 13:31:48.530528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 272/536] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:48 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:48.860745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:48.861640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:48.873622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.874439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.875168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:48.876636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:48.877411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:48.878233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.008015 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.010952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:49.011548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:49.016393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-27fa0218-8c85-45cf-80f5-707786c23149 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.162806 Oct 11 13:31:49.017117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 265/537] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:48 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:49.019215 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.019699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.020151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.020891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.021352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.021774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.152618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.161420 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.162866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.164002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b0221cbf-fd4c-4c31-be88-a459373ba27f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.156983 Oct 11 13:31:49.164641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 273/538] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:49 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:49.563254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:49.563632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:49.564301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:49.564559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:49.574187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.574495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.574972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.575212 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.575871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.576182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.577119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.577343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:49.577875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.578096 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:49.578571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.578793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:49.769334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.771962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:49.777432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6df5bbba-ed5b-49e3-a694-0b3b0227ec56 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.220212 Oct 11 13:31:49.781214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 274/539] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:49 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:49.781360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8025f389-9a20-4a24-bb2a-1da8284a74d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.223580 Oct 11 13:31:49.781360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 266/540] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:49 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:31:50.043088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:50.044145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:50.054898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.055697 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.056500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.057639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.058399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.059109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.189404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:50.190747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:50.196423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:50.197324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.197793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.198206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.198903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.199349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.199768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.204723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2458071d-87b3-40a8-a4f3-d74470eff8ef tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.167718 Oct 11 13:31:50.204723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 275/541] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:50 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:50.329652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:50.338555 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:50.339990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:50.341178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3ed26371-7382-4cbf-baeb-f5e26b1c0005 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.155710 Oct 11 13:31:50.341732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 267/542] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:50 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:50.803736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:50.804826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:50.807893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:50.808936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:50.814845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.815692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.816097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.816841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.817292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.817623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.817782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.818138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.818579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:50.819261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:50.819715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:50.820145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:51.011102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.018219 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.019662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0044c8e9-db61-4963-9f9c-6e9af31a5c6b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.222228 Oct 11 13:31:51.020272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 276/543] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:50 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:51.026715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4c272c1d-306c-4639-85f6-59510e25b67f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.225493 Oct 11 13:31:51.027310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 268/544] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:50 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:51.232787 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:51.233773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:51.242166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:51.242653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:51.243092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:51.243781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:51.244271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:51.244702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:51.374754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:51.375309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:51.380407 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.382150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:51.382636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:51.383067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:51.383760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:51.383910 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:51.384306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:51.384727 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:51.390238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e8695343-b1c3-48e7-99f9-baaf2bd67ddf tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.163681 Oct 11 13:31:51.390851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 277/545] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:51 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:51.404761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:31:51.516505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.525351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.526770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:51.527926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ce2401d5-fbcd-49f5-87d7-c54d0876d275 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.157296 Oct 11 13:31:51.528523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 269/546] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:51 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:52.043335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:52.044086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:52.049620 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:52.050344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:52.050667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.051188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.051629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.052358 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.052817 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.053250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.056497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.056978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.057411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.058090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.058525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.058974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.247310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.250578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.256325 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-789a8d6a-de74-46af-aee7-c72779d57048 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.210536 Oct 11 13:31:52.256908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 270/547] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:52 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:52.258763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b84e6c63-26a6-405d-b264-146c1015de38 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.219551 Oct 11 13:31:52.259372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 278/548] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:52 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:52.413932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:52.414541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:52.421548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.422026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.422460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.423145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.423597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.424017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.553120 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.554496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:52.555090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:52.561160 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.561294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-63e90034-46e1-49c2-a1f2-612379c90136 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.151379 Oct 11 13:31:52.561642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.562135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 271/549] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:52 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:52.562249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.562795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:52.563244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:52.563674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:52.696192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.707912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.709395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:52.710543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f5eb7238-c76f-4136-93d5-4217075a5810 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.160144 Oct 11 13:31:52.711100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 279/550] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:52 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:31:53.280709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:53.281329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:53.281845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:53.282495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:53.287740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.288274 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.288708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.289118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.289402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.289589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.289856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.290002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.290282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.290690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.291135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.291552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.479911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.483098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.487860 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-65620752-5504-44b6-9c73-bbd3ebd96acf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.209575 Oct 11 13:31:53.488753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 280/551] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:53 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:53.492269 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-289f36c0-21b3-4956-a315-fa80565c02c3 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.215481 Oct 11 13:31:53.492824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 272/552] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:53 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:53.585206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:53.585733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:53.592267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.592792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.593243 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.593974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.594425 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.594873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.728987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.736539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:53.737168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:53.737335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2a13e3f4-0783-4dcc-acb6-707107a71e06 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.156367 Oct 11 13:31:53.737853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 281/553] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:53 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:53.743135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.743610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.744045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.744764 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:53.745214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:53.745631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:53.877865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.888312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.890056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:53.891211 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cefc6643-a403-449c-b322-da0dd0e02639 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.158708 Oct 11 13:31:53.891766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 273/554] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:53 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:54.516677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:54.517647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:54.519088 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:54.520179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:54.528085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.528940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.529662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.530832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.531060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.531559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.531803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.532309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.532547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.533398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.534151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.534974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.724660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:54.727995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:54.732656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-feb36ba1-5df5-4ec2-8430-617782433f4b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.223067 Oct 11 13:31:54.733202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 282/555] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:54 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:54.736740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-813302f9-abd7-4dec-8c19-729331e3835f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.224524 Oct 11 13:31:54.737440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 274/556] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:54 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:54.760159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:54.760854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:54.767105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.767494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.767921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.768629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.769072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.769567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.917000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:54.917721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:54.924366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.924855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.925288 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:54.926116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:54.926564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:54.926986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:55.174520 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.181720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.182946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-63966f82-ba68-4180-87ff-992a241d328d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.426806 Oct 11 13:31:55.183722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 283/557] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:54 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:55.190089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.191562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.192740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-367e7043-f389-458b-927b-68b4a6e3d938 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.279798 Oct 11 13:31:55.193866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 275/558] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:54 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:55.759567 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:55.760568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:55.763537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:55.765334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:55.770874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:55.771360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:55.771790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:55.772527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:55.772977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:55.773402 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:55.773608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:55.774087 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:55.774518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:55.775233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:55.775733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:55.776140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:55.967323 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.970070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:55.976090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2976bf7c-1d12-4e10-962f-07cac7e50430 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.219128 Oct 11 13:31:55.976705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 276/559] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:55 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:55.979281 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d0519871-fce2-49ad-93e4-c36c0663c714 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.226190 Oct 11 13:31:55.979923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 284/560] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:55 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:56.209726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:56.210625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:56.218987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:56.219590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:56.220163 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:56.221045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:56.221617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:56.221789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:56.222150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:56.222806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:56.229169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:56.229645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:56.230090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:56.230787 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:56.231223 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:56.231640 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:56.407956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:56.414627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:56.416322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5e502066-53ba-460e-89cd-e188c4f034b1 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.213025 Oct 11 13:31:56.416900 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 277/561] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:56 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:56.423077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:56.424620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:56.425906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f53fa0bf-890c-46b3-b25f-2a83ff6e0325 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.208947 Oct 11 13:31:56.426445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 285/562] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:56 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:57.001381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:57.001996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:57.002848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:57.003455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:57.009036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.009551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.009992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.010177 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.010691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.010827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.011133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.011374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.011561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.011825 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.012305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.012731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.206051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.209188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.214965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6f18728e-39f5-423a-bf3e-00e750dd9db1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.217522 Oct 11 13:31:57.215467 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 278/563] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:56 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:57.217572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-de12fab6-d190-4fe3-a9d0-a7ae4c12a9f0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.218501 Oct 11 13:31:57.218173 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 286/564] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:56 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:57.441438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:57.442688 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:57.449713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.450201 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.450630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.451128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:57.451285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.451729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:57.451884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.452131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.458082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.458561 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.458988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.459671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:57.460139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:57.460584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:57.645939 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.649172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.654160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6a9ef954-0ca0-4fda-aceb-429352a23a8f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.217998 Oct 11 13:31:57.654878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 279/565] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:57 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:57.658310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.659880 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:57.661200 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-359f4e4d-861e-422a-8e35-1e23cc0b32b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.214139 Oct 11 13:31:57.661831 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 287/566] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:57 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:58.239392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:58.239915 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:58.240345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:58.240647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:58.246893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.247360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.247529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.247787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.247957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.248319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.248489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.248922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.249084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.249324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.249540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.249927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.445880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.449324 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.454523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2c0d0464-93db-48c6-b733-53d24b39a7a9 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.218940 Oct 11 13:31:58.455124 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 280/567] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:58 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:58.457487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c65c40ff-f3e5-4699-90a1-6c99c78203a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.221383 Oct 11 13:31:58.458054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 288/568] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:58 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:58.681345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:58.682352 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:58.691056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:58.692040 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:58.692659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.693469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.694199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.695346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.696388 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.697111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.702282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.703065 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.703828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.704986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:58.705728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:58.706410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:58.895502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.899725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.909384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.910714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-42057a8f-10fa-41e2-9ba5-b47b73a22370 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1358 microversion: 2.1 time: 0.236004 Oct 11 13:31:58.911263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:58.911426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 281/569] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:58 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:58.912724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3cd51133-27a9-4266-944a-c8c8e2f2b7e5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1739 microversion: 2.20 time: 0.227937 Oct 11 13:31:58.913273 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 289/570] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:58 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:31:59.478198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:59.478804 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:59.480395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:59.481012 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:59.485273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.485772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.486210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.486904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.487355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.487685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.487833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.488182 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.488634 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.489328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.489784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.490259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.681108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:59.683715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:31:59.689569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2ab13c66-a23c-49a7-8ed2-821d767a058b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.215158 Oct 11 13:31:59.690145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 282/571] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:59 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:59.691890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-57f6d698-7add-457d-8409-f782323a4393 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.215297 Oct 11 13:31:59.692559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 290/572] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:59 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:31:59.933560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:59.934489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:59.937574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:31:59.938752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:31:59.941095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.941671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.942171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.942980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.943656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.944101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.946161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.946714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.947115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:31:59.947795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:31:59.948519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:31:59.949127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.142410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.146553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.151086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9f77bab0-a22c-44e3-8a7a-b57970eb7645 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1548 microversion: 2.1 time: 0.221570 Oct 11 13:32:00.151716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 283/573] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:31:59 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:00.155274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.156765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.157955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9940830b-e667-405e-a277-88b178b282ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1721 microversion: 2.20 time: 0.224336 Oct 11 13:32:00.158497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 291/574] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:31:59 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:00.173822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:00.174443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:00.180653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.181130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.181873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.182583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.183069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.183491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.331008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.339530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-21d18b81-480b-4682-8a19-b632dadde44f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1548 microversion: 2.1 time: 0.169489 Oct 11 13:32:00.353337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 284/575] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:00 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:00.363344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:00.368528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.369320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Searching by: {'deleted': False, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68'} {{(pid=118880) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 13:32:00.376149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.376648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.377083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.377882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.378435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.378870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.476047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.multi_cell_list [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118880) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 13:32:00.531260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16d3793-e4d8-4a6b-8cba-9e0e20d70722", "name": "network-vif-plugged", "status": "completed", "tag": "1112479d-152b-4660-a6ed-8584f3470465"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:00.547033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.547520 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.548010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.578465 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] Creating event network-vif-plugged:1112479d-152b-4660-a6ed-8584f3470465 for instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 on hv-cinder-85061 Oct 11 13:32:00.591187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-53d3a9f8-9881-427a-8434-bf775ba34bde req-8fe56abd-e70d-4e6b-bae3-51950481650d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063722 Oct 11 13:32:00.592814 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 285/576] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:00.602552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5b38b19c-cda6-4e71-add9-3cc89cb60851 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.243134 Oct 11 13:32:00.603765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 292/577] 10.222.0.15 () {58 vars in 1125 bytes} [Tue Oct 11 13:32:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:00.624539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:00.625249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:00.634683 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.635216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.635651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.636374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.636824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.637240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.714818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:00.715827 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:00.725650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.727601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.730823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.731582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.732079 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.734749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.864398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.868620 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:00.877972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a77ef1f2-cfd3-472a-ae56-d6cb260e2b14 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1548 microversion: 2.1 time: 0.266113 Oct 11 13:32:00.878996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 286/578] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:00 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1548 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:32:00.883724 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:00.884436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:00.891023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.891590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.892032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.892757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:00.893554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:00.894217 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:00.987889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:00.996971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3c2a350d-2997-4db7-8f12-bdeea824e6c6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.286272 Oct 11 13:32:00.997646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 293/579] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:00 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:01.053623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:01.061441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-85c3f4dc-4fad-4651-801d-3527874fc459 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.181394 Oct 11 13:32:01.062012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 287/580] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:00 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:01.183648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:01.184321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:01.190478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:01.190969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:01.191405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:01.192096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:01.192585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:01.193045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:01.197408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:01.327914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:01.340510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:01.342727 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:01.344089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-18081de3-ba95-415b-aee9-7485545358b8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1721 microversion: 2.20 time: 0.164264 Oct 11 13:32:01.345195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 294/581] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:01 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:02.025647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:02.029276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:02.038901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.039392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.039824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.040551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.041008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.041436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.085037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:02.085684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:02.092180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.092668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.093107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.093794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.094244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.094666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.228845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:02.238203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5f7bff72-8d5e-4158-b156-26d1a6605634 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.219023 Oct 11 13:32:02.238878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 288/582] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:02 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:02.256561 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:02.264401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6e3092eb-22f0-48ca-b6b2-6fb6ff836cb0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.183199 Oct 11 13:32:02.265317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 295/583] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:02 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:32:02.369412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:02.370139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:02.376359 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.376934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.377422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.378173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.378562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.379017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.465033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6d0e792-363f-40b3-aaf7-93fcd838ddc7"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:02.467464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:02.473514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.473969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.474438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.475322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.475951 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.476410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.514207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:02.523071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:02.524612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:02.525754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0bc0e53d-3cd6-46c0-83f6-e3f8318ef117 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1721 microversion: 2.20 time: 0.160322 Oct 11 13:32:02.526297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 289/584] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:02 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:02.634001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "name": "network-vif-unplugged", "status": "completed", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:02.644107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:02.644602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:02.645032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:02.656640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] Creating event network-vif-unplugged:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:32:02.662026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-d909b2ae-4fc7-4458-94c2-8f167fef83fa req-16d3952b-e325-4646-a35d-805b4642cbd7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032008 Oct 11 13:32:02.662581 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 290/585] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:03.267031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:03.268182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:03.276413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.276903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.277339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.278029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.278479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.278910 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.412839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:03.421374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d9ab2fd0-6a5d-4815-9edf-73ae9dcf3b12 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.161851 Oct 11 13:32:03.421956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 291/586] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:03 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:03.426342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:03.426940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:03.432716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.433198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.433644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.434308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.434784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.435212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.574997 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:03.583123 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-96b47b31-b465-4dbc-b100-d33ee7690983 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1366 microversion: 2.1 time: 0.160155 Oct 11 13:32:03.583690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 292/587] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:03 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:03.588198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:03.588845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:03.595303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.595868 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.596446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.597224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.597757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.598295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.742296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:03.752032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:03.753490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:03.754636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f599b7a0-3066-4431-9705-305d34552ec9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1721 microversion: 2.20 time: 0.169979 Oct 11 13:32:03.755193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 293/588] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:03 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:03.801180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-043cdcc4-0fd8-4af7-a037-0b1ba811ef41 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.339955 Oct 11 13:32:03.802063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 296/589] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:32:02 2022] POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:03.829150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:03.829653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:03.836285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.836770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.837201 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.837891 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:03.838464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:03.838895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:03.970195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lazy-loading 'services' on Instance uuid 952391a8-5c18-4380-9171-d53c53effc90 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:32:04.103188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6913c10c-c27d-433f-b0b2-67309596de09 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90/os-volume_attachments/07413a9d-a31e-4a1d-9f78-61016abacb07" status: 202 len: 0 microversion: 2.1 time: 0.280370 Oct 11 13:32:04.103782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 294/590] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:32:03 2022] DELETE /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90/os-volume_attachments/07413a9d-a31e-4a1d-9f78-61016abacb07 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:32:04.449782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:04.450923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:04.463711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.464643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.467367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.467367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.467367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.468295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.609718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:04.610532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:04.617265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.617904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.618350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.619045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.619589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.620029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.643988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:04.652382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f079ab7f-b315-4e93-957b-4fc1ccce6f6b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.210366 Oct 11 13:32:04.652952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 297/591] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:04 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:04.750910 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:04.759371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-df9e5c67-a231-4e34-9efa-e8dab19346b6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1556 microversion: 2.1 time: 0.156069 Oct 11 13:32:04.759881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 295/592] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:04 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:04.781210 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:04.781783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:04.782389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:04.783000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:04.788061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.788574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.789003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.789205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.789685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.789790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.790125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.790221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.790541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.790825 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:04.791282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:04.791711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:04.907399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-59a9d059-e606-4a2c-a01a-85c8dc6c4111 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129059 Oct 11 13:32:04.908051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 296/593] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:32:04 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:05.136066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.144571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.146043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.147202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0caf8e12-d3f8-41f6-8b9b-0371f11f068f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1724 microversion: 2.20 time: 0.370048 Oct 11 13:32:05.147792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 298/594] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:04 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:05.176030 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "644a7cdc-ff51-4cf9-82d7-22f3dcf56c57"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:05.178945 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:05.185690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.186295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.186968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.187763 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.188349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.188885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.473450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-acebea25-78b0-4d80-8cdd-7e9e6cf264ac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305356 Oct 11 13:32:05.474326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 297/595] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Oct 11 13:32:05 2022] POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:32:05.602248 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:05.602855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:05.609516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.610006 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.610441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.611312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.611768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.612580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.658213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118880) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 13:32:05.675804 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:05.676519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:05.684338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.684821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.685450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.686322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.686777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.687202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.731012 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bee534ad-60e5-4eab-82df-c2bd2297bc4b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/action" status: 202 len: 0 microversion: 2.20 time: 0.132768 Oct 11 13:32:05.732332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 299/596] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 11 13:32:05 2022] POST /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:32:05.739914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:05.740563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:05.746571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.747056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.747487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.748212 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:05.748664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:05.749088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:05.906855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.916235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-714cafa2-9a83-4ae1-945e-7e0cca362791 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.244491 Oct 11 13:32:05.917473 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 298/597] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:05 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:05.944187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.953155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.954562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:05.955975 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-49fb2a48-a1ee-4409-ac4e-c3b10b958552 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1750 microversion: 2.20 time: 0.219832 Oct 11 13:32:05.956571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 300/598] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:05 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:06.304974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16d3793-e4d8-4a6b-8cba-9e0e20d70722", "tag": "1112479d-152b-4660-a6ed-8584f3470465"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:06.315644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:06.316523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:06.317173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:06.329388 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] Creating event network-changed:1112479d-152b-4660-a6ed-8584f3470465 for instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 on hv-cinder-85061 Oct 11 13:32:06.334972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-99fd7b74-39d5-46a5-9a56-56bb3a3e936b req-d2bfa0e8-fdb2-4196-9d72-accb39df8c57 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Oct 11 13:32:06.336011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 299/599] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:06.939961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:06.940748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:06.947418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:06.947953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:06.948409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:06.949121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:06.949570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:06.949988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:06.984058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:06.984999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:06.991904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:06.992504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:06.992997 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:06.993784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:06.994325 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:06.994816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:07.154575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:07.163175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0722f398-967f-4580-bd24-a1696bf29c13 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.227132 Oct 11 13:32:07.163753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 301/600] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:06 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:07.172608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:07.181944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:07.183387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:07.184589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-00fda696-3a26-4afd-9789-c509fc77d088 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1752 microversion: 2.20 time: 0.205719 Oct 11 13:32:07.185150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 300/601] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:06 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:08.186801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:08.187372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:08.194225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.194672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.195136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:08.195851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.196335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.196757 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:08.209721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:08.210389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:08.217529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.217894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.218324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:08.219042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.219484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.219905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:08.360747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:08.369871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a1b8b816-5789-46f2-90a8-e7a79ed3286b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.186899 Oct 11 13:32:08.373788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 302/602] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:08 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:08.425211 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:08.428777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:08.434501 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:08.435958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:08.437638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ad30a276-a29f-467a-a04b-3ff245bf5f44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1752 microversion: 2.20 time: 0.231353 Oct 11 13:32:08.437638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 301/603] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:08 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:08.880551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:08.883704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:08.890799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.891312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.891746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:08.892480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:08.892921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:08.893343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:09.152682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3ef74907-ebe1-4dc2-b42a-a492f1120e9e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278903 Oct 11 13:32:09.153288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 303/604] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:32:08 2022] POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:09.398082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:09.398995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:09.412642 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:09.413403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:09.414018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:09.414730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:09.415182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:09.415601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:09.463192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:09.463875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:09.470564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:09.471073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:09.471776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:09.472718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:09.473510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:09.474308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:09.615463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:09.624303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c278e15d-3d0a-4f3e-9d50-7790e7f69243 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1724 microversion: 2.1 time: 0.233064 Oct 11 13:32:09.625105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 302/605] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:09 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:09.645027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:09.654009 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:09.655443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:09.656649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f8dad24e-1f60-4bc1-9171-ed137122dfa9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1752 microversion: 2.20 time: 0.198094 Oct 11 13:32:09.657207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 304/606] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:09 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1752 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:10.651053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:10.651748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:10.659921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.660509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.661010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.661815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.662371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.662869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.682190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:10.682826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:10.685311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:10.685977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:10.691529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.692003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.692460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.693146 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.693589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.694008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.855230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:10.866824 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:10.867901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-efd63c54-c956-479e-beea-323103b247bc tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1701 microversion: 2.1 time: 0.222142 Oct 11 13:32:10.868603 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 303/607] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:10 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1701 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:10.875846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:10.877315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:10.878474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b382d381-a9eb-451d-9ea7-9a8cfb70333c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1752 microversion: 2.20 time: 0.200271 Oct 11 13:32:10.879084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 305/608] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:10 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:10.891184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:10.897448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.897934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.898368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.920847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Going to try to start instance {{(pid=118881) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 13:32:10.965304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-081b28b6-c797-47c3-8c09-8e8eaec59b1e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action" status: 202 len: 0 microversion: 2.1 time: 0.078240 Oct 11 13:32:10.965889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 304/609] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:32:10 2022] POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:32:10.975487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:10.976261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:10.982231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.982715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.983136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:10.983821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:10.984294 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:10.984696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:11.139308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:11.152186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-33e64b5c-d729-4d59-b34f-48de40a8d588 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1710 microversion: 2.1 time: 0.180101 Oct 11 13:32:11.153014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 306/610] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:10 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:12.019999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:12.020766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:12.027449 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.027925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.028423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.029125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.029577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.030001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.166006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:12.175371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:12.176722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:12.177635 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:12.179464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:12.181466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2e8a615a-f217-44bd-80a6-ca82ff26be68 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1752 microversion: 2.20 time: 0.278334 Oct 11 13:32:12.182649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 305/611] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:11 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:12.184947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.185778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.186240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.187145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.187799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.188226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.192847 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:12.346725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:12.355689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-aee718aa-c19a-49ea-ba7b-0abbed10da66 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1710 microversion: 2.1 time: 0.184303 Oct 11 13:32:12.356467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 307/612] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:12 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:32:12.566904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:12.567508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:12.574836 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.575318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.575753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.576495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.577006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.577444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.700321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:12.701061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:12.707434 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.707981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.708432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.709395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.709999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.710853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.717851 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:12.726400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-05c16858-7335-42a8-a75e-af7b4afd0453 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1594 microversion: 2.1 time: 0.163577 Oct 11 13:32:12.727296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 306/613] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:12 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1594 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:12.737296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:32:12.830555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fff77340-8a72-402e-8124-37aa14bc5745 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 204 len: 0 microversion: 2.1 time: 0.133965 Oct 11 13:32:12.831456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 308/614] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:32:12 2022] DELETE /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:32:12.839554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:12.840176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:12.846193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.846675 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.847118 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:12.847809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:12.848294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:12.848713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:13.086125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:13.094096 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b5f3a34e-9afd-48be-b6bd-3ff6baa65764 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1514 microversion: 2.1 time: 0.258519 Oct 11 13:32:13.094702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 307/615] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:12 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:32:13.207798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:13.208523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:13.215377 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:13.215931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:13.216418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:13.217164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:13.217579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:13.218026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:13.380261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:13.381192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:13.388477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:13.389090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:13.389919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:13.390783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:13.391429 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:13.391829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:13.414615 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:13.425055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:13.426488 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:13.427630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f2858f62-c158-484f-8cb1-7010be59415a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.224326 Oct 11 13:32:13.428203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 309/616] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:13 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:13.632857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:13.642190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fcb4f79c-7d46-467b-a1bf-0e423b57582a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1710 microversion: 2.1 time: 0.266372 Oct 11 13:32:13.642738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 308/617] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:13 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1710 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:14.121768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:14.122363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:14.128589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.129073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.129505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.130199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.130649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.131067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.373839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:14.382582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-75d23d5e-0ece-49d4-af1c-0fdb9334cea7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1514 microversion: 2.1 time: 0.264816 Oct 11 13:32:14.383174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 310/618] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:14 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:14.454981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:14.455590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:14.462438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.462927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.463353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.464052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.464528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.464922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.666250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:14.666854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:14.673066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.673544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.673972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.674688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:14.675149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:14.675568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:14.679456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:14.692199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:14.694490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:14.695874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7e0f5cfd-cfba-48a3-b950-d62f153521fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.244842 Oct 11 13:32:14.696534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 309/619] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:14 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:15.088242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:15.096986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8e31ff91-3ffa-46d6-8002-9270815a167c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1714 microversion: 2.1 time: 0.434815 Oct 11 13:32:15.097600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 311/620] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:14 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1714 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:15.122620 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:15.133150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:15.134067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:15.134887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:15.150587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] Creating event network-changed:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:32:15.155676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-cb98fe23-4671-4b1a-bc91-5ca9bd654400 req-09db7121-125c-453d-9865-e1450873a64e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036636 Oct 11 13:32:15.156636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 310/621] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:15.406744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:15.407245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:15.421768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:15.422268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:15.422704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:15.425759 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:15.426404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:15.427002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:15.647561 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:15.675604 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-af551e8e-958d-403a-a2b2-f486a2b3389f tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1514 microversion: 2.1 time: 0.270648 Oct 11 13:32:15.695947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 312/622] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:15 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:15.723079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:15.723746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:15.734056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:15.734575 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:15.734982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:15.741461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:15.742101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:15.742752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:15.954019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:15.970949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:15.974890 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:15.976176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8b210121-5587-42cd-b8f0-a4d486d0beb4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.258036 Oct 11 13:32:15.976775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 311/623] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:15 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:16.171463 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952391a8-5c18-4380-9171-d53c53effc90", "name": "network-vif-deleted", "tag": "56635b26-a391-4908-917c-b5b4cc32c9f7"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:16.193579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.194498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.194977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.207754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] Creating event network-vif-deleted:56635b26-a391-4908-917c-b5b4cc32c9f7 for instance 952391a8-5c18-4380-9171-d53c53effc90 on hv-cinder-85061 Oct 11 13:32:16.214993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-fce4df44-ebdb-4d22-a28d-a51e3b840989 req-0e2b6bcb-c507-4f81-b910-ab219e26bf65 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047129 Oct 11 13:32:16.215820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 313/624] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:16.399826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1743799828"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:16.400403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:16.406596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.407050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.407510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.408230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.408680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.409099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.550350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.network.security_group_api [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Adding security group 49faddb5-a5ac-4208-a16b-96d30ed7fdef to port 46db3884-5f07-4b1a-ba2e-5421ca606433 Oct 11 13:32:16.702012 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:16.703301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:16.710254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.711138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.711792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.712718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.713605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.714433 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.750328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:16.750896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:16.751390 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:16.751890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lazy-loading 'fault' on Instance uuid 952391a8-5c18-4380-9171-d53c53effc90 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:32:16.812453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:16.821833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-68c47ad1-6c6d-48ed-9da9-3e8ff259da17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1309 microversion: 2.1 time: 0.124287 Oct 11 13:32:16.836796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 314/625] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:16 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:17.002823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d82ca59f-939a-4c7a-8c31-c07218ef7a0f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.606863 Oct 11 13:32:17.005245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 312/626] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:32:16 2022] POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:32:17.009442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:17.010280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:17.011762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:17.012455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:17.017734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.018705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.019215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.019702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.019822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.020147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.020893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.021350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.021761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.021887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.022427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.023762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.230468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:17.239327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:17.241048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:17.242257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bd400e08-ee74-4b7e-b610-5f3d8c410049 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.243182 Oct 11 13:32:17.243467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 315/627] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:16 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:17.247923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:17.257582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.258392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.259067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.261311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:17.271960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] Creating event network-changed:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:32:17.273903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0de3e9cc-3131-4692-a861-d12bdd76efd5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1759 microversion: 2.1 time: 0.266263 Oct 11 13:32:17.274489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 313/628] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:17 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:17.277735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-f96b7dd4-5267-48ea-bc38-09033b643a06 req-29b8338b-cd4c-4122-8083-085cdf2c9cd5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033004 Oct 11 13:32:17.278514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 316/629] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:32:17.846154 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:17.846985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:17.849426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:17.854837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.855319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.855749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.856458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.856921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.857340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.892151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:17.893113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:17.893113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:17.893479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lazy-loading 'fault' on Instance uuid 952391a8-5c18-4380-9171-d53c53effc90 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:32:17.934876 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:17.942988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a49afb3b-a998-4bc2-908e-ce328c777984 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 200 len: 1309 microversion: 2.1 time: 0.100633 Oct 11 13:32:17.943595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 314/630] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:17 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:18.271923 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:18.274020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:18.283771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:18.284427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:18.284757 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:18.285533 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:18.285988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:18.287005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:18.465547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:18.478460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:18.480966 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:18.482330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-39d30818-5de7-4a6f-8bdd-3779552e0913 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.219213 Oct 11 13:32:18.483043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 317/631] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:18 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:18.965886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:18.966456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 952391a8-5c18-4380-9171-d53c53effc90] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:18.973207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:18.973689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:18.974125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:18.974823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:18.975280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:18.975740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:18.989534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] HTTP exception thrown: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Request method failure captured: Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 HTTP/1.1 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXAFyJ1EhZYsO5or-ppkLtKa_G_ho4XScPH6IdXQP2ZSnVJaJvjuvqkNPfa3u5eVtWVnYsuJcRyicwppPIRZ_eQXXZ4a0OSsgb9bvJGD2W1hhRCdGqLDkgDUBQ_mbw922CR4Avay6WnpOl1XJ1PqdcsSma3Z8IEZIYR7igvoSAt8_ek Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 192799a3ba9a4c0e981f6813a0341768 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:32:18.991253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/192799a3ba9a4c0e981f6813a0341768"}]}] Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 192799a3ba9a4c0e981f6813a0341768 Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesSnapshotTestJSON-742068844-project Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 71b6993791904a50a94ba0f980c9c0c6 Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesSnapshotTestJSON-742068844-project Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. Oct 11 13:32:18.992976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '952391a8-5c18-4380-9171-d53c53effc90'} Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:32:18.993866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. Oct 11 13:32:18.995149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:32:18.996248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Returning 404 to user: Instance 952391a8-5c18-4380-9171-d53c53effc90 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:32:18.996248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cbdf5010-6e56-4a39-a318-cd8d42081d97 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90" status: 404 len: 111 microversion: 2.1 time: 0.030734 Oct 11 13:32:18.996248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 315/632] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:18 2022] GET /compute/v2.1/servers/952391a8-5c18-4380-9171-d53c53effc90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:32:19.509773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:19.510395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:19.518014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:19.518506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:19.518944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:19.519635 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:19.520090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:19.520550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:19.661438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:19.670326 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:19.671774 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:19.672980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-db2d5f59-6621-453b-ac27-1228ff1950bc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.167397 Oct 11 13:32:19.673548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 318/633] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:19 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:20.702845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:20.703847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:20.714766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:20.715564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:20.716463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:20.717578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:20.718353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:20.719055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:20.863266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:20.872286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:20.873703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:20.874857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f21a3e5d-98a5-467f-999c-e50bcdc15da4 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.178806 Oct 11 13:32:20.875404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 316/634] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:20 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:21.900416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:21.901035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:21.907952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:21.908518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:21.908959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:21.909660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:21.910115 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:21.910542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:22.050213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:22.059191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:22.060729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:22.061881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0bd0687e-533d-4c02-9c41-63b95898b97c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.165617 Oct 11 13:32:22.062530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 319/635] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:21 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:23.092639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:23.093593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:23.104278 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:23.104898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:23.105363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:23.106095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:23.106555 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:23.106973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:23.252673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:23.262122 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:23.279833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:23.281263 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bbc77c0d-b809-48c1-b665-7c806a8e4ebb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.195438 Oct 11 13:32:23.282252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 317/636] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:23 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:24.318550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:24.319686 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:24.327439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:24.327952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:24.328396 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:24.329125 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:24.329536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:24.330038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:24.476481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:24.485103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:24.486544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:24.487705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d8618bfc-d5ea-4eea-a42e-f23a6a3ffb08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.176572 Oct 11 13:32:24.488311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 320/637] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:24 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:25.513731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:25.514723 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:25.527545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:25.527545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:25.527545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:25.527545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:25.528074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:25.528074 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:25.665421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:25.669034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:25.675374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:25.676943 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:25.678187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8c78250d-27e6-4210-bebf-066b73531d0a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.169046 Oct 11 13:32:25.678841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 318/638] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:25 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:26.708464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:26.709459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:26.722156 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:26.722954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:26.723662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:26.724900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:26.726619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:26.727342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:26.868069 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:26.877340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:26.878980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:26.880005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-36d2382b-f4fe-459a-943c-707b9b2573aa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.178257 Oct 11 13:32:26.880588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 321/639] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:26 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:27.905418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:27.906049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:27.909244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:32:27.909397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Tue Oct 11 13:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 (ip 10.222.0.15) !!! Oct 11 13:32:27.925517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:27.926345 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:27.927007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:27.927744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:27.928237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:27.928654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:28.067656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:28.076786 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:28.078253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:28.079418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d0fc2ee6-9add-4da4-a465-d7ec8957a3ae tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.178162 Oct 11 13:32:28.079931 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 319/640] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:27 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:29.104814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:29.105489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:29.112677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:29.113187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:29.113600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:29.114730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:29.115242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:29.115882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:29.258730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:29.267921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:29.269395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:29.270565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-095ea762-b69e-4280-b187-042f91c36987 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.169989 Oct 11 13:32:29.271129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 322/641] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:29 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:30.298731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:30.299533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:30.309137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:30.309838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:30.310501 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:30.311199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:30.311659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:30.312089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:30.447339 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:30.455962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:30.457435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:30.458602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-de1b4c1d-e45e-4bb3-8432-e50264ac3bea tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.165568 Oct 11 13:32:30.459170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 320/642] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:30 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:31.488948 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:31.489942 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:31.501039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:31.501849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:31.502582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:31.503726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:31.504533 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:31.505242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:31.512018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:31.642300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:31.651647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:31.653128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:31.654354 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b3bcdbd7-312a-4d9b-885e-a2b53a59e745 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.172056 Oct 11 13:32:31.654918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 323/643] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:31 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:32.681075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:32.681719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:32.688798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:32.689286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:32.689731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:32.690425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:32.690873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:32.691291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:32.832100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:32.841294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:32.842780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:32.843940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-150b3385-0ee3-4a76-9afb-47d264f531c9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.167576 Oct 11 13:32:32.844548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 321/644] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:32 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:33.874496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:33.875108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:33.882164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:33.882656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:33.883099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:33.883806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:33.884302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:33.884742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:34.021859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:34.030905 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:34.032384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:34.033600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-434d5087-aef6-498d-b634-ebcbb6c4e6ca tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.165814 Oct 11 13:32:34.034178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 324/645] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:33 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:35.058926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:35.060341 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:35.068054 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:35.068806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:35.069424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:35.070540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:35.071474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:35.072078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:35.103528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1446225020", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "networks": [{"uuid": "059a7050-6e7e-4e2f-bd2d-1ed7ceb787a3"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:35.165177 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] validate_networks() for [('059a7050-6e7e-4e2f-bd2d-1ed7ceb787a3', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:32:35.261403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:35.271171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:35.272863 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:35.274048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c34c4e4b-7e91-4d3f-acb7-dfc8fec86f9c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.219134 Oct 11 13:32:35.274877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 322/646] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:35 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:35.593758 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:32:35.594176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:32:35.594643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:32:35.595043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:32:35.595450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:32:35.605228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:35.605709 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:35.606137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:35.606862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:35.607317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:35.607742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:35.625142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Getting quotas for project 192799a3ba9a4c0e981f6813a0341768. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:32:35.629240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Getting quotas for user 71b6993791904a50a94ba0f980c9c0c6 and project 192799a3ba9a4c0e981f6813a0341768. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:32:35.641224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:32:35.643601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:32:35.691524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5b5e1349-d868-414d-93ae-37c9adacfe38 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591774 Oct 11 13:32:35.692307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 325/647] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:32:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 13:32:35.703643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0769b9a2-9f53-4ba3-99b0-646f39bde0f5 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:35.704319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0769b9a2-9f53-4ba3-99b0-646f39bde0f5 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:35.757507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0769b9a2-9f53-4ba3-99b0-646f39bde0f5 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:35.765102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0769b9a2-9f53-4ba3-99b0-646f39bde0f5 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1219 microversion: 2.1 time: 0.065379 Oct 11 13:32:35.765681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 323/648] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:35 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:36.305078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:36.305913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:36.316997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:36.317472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:36.317939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:36.318677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:36.319124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:36.319553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:36.459850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:36.469111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:36.470571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:36.471731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-50248b6e-c6d7-44b6-b03c-2183fd2a990d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.174735 Oct 11 13:32:36.472311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 326/649] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:36 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:36.791944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:36.792972 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:36.801257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:36.801747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:36.802183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:36.802875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:36.803330 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:36.803758 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:36.868601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:36.879370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a3ac881f-6bef-4f78-be78-6b801a187eeb tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1223 microversion: 2.1 time: 0.093553 Oct 11 13:32:36.880091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 324/650] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:36 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:37.500990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:37.501986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:37.512796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:37.513590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:37.514666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:37.516004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:37.516534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:37.516897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:37.654956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:37.664209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:37.665862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:37.667016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-17feac47-d681-41ae-a0a2-799ce360b92d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.172884 Oct 11 13:32:37.667561 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 327/651] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:37 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:37.906988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:37.907661 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:37.915240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:37.915775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:37.916308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:37.917075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:37.917579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:37.918055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:37.981866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:37.989669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6f10ec4e-1f4a-4b09-970b-e8490064df5a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1215 microversion: 2.1 time: 0.089118 Oct 11 13:32:37.990225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 325/652] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:37 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:38.375884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:38.379302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:38.386726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.387266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.387709 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.388495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.388852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.389752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.416226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'flavor' on Instance uuid 8920d883-8c41-45a3-bcd1-06959e5be7cb {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:32:38.538736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e863a93e-692a-4b32-8480-20899c64ef9a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/action" status: 200 len: 32 microversion: 2.1 time: 0.167234 Oct 11 13:32:38.539353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 328/653] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:32:38 2022] POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:32:38.549103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:38.549839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:38.555976 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.556502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.556946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.557637 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.558111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.558547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.693697 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:38.694418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:38.698801 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:38.701193 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.701672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.702103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:38.703273 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:38.703676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:38.707360 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-925b76c9-cdbb-4d7d-85c5-46475f3360d1 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.162332 Oct 11 13:32:38.708151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 326/654] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:38 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:38.847511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:38.855957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:38.857460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:38.858629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-81a4247e-1b94-4515-8563-525ca4648456 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.169331 Oct 11 13:32:38.859201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 329/655] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:38 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:39.012836 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:39.013705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:39.022240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.022962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.023624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:39.024535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.025220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.025903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:39.088593 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:39.096338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3c117733-c8c4-497f-bc25-ea5152cbb628 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1277 microversion: 2.1 time: 0.087666 Oct 11 13:32:39.096872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 327/656] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:39 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:39.730381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:39.731110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:39.738107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.738595 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.739247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:39.739927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.740594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.741019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:39.878297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:39.883895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:39.884545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:39.887378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7c1122fe-d4fd-49b6-8ead-d76f92081549 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.160830 Oct 11 13:32:39.887952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 330/657] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:39 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:39.904008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.904008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.904008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:39.904008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:39.904689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:39.904689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:40.022823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:40.031826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:40.033305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:40.034491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-32cacae1-beff-4ef3-a4c1-28d2311ad637 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.154434 Oct 11 13:32:40.035255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 328/658] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:39 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:40.119297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:40.119919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:40.126072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:40.126553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:40.127022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:40.127753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:40.128408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:40.129119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:40.263931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:40.272474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7b13f495-1bd2-4017-b2c5-7ffab227fe17 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.157084 Oct 11 13:32:40.273251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 331/659] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:40 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:40.648224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d6f96bf-d771-4540-929b-a86b306ce1e7", "tag": "379734d2-01aa-4233-b661-12929a925cb1"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:40.658145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:40.658648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:40.659066 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:40.670113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] Creating event network-changed:379734d2-01aa-4233-b661-12929a925cb1 for instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 on hv-cinder-85061 Oct 11 13:32:40.675648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-54310577-aa94-49d4-9706-3bf2db1053a0 req-c1486f13-f4a4-4192-bc5d-8f8318092920 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092252 Oct 11 13:32:40.676417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 329/660] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:40.911721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:40.912341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:40.914721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:40.920817 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:40.921348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:40.921823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:40.922593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:40.923067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:40.923481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:41.059299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:41.060749 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:41.061450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:41.068023 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-530f8472-53c1-4487-b7ff-9e8c463e6163 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.160278 Oct 11 13:32:41.068233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:41.068545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:41.068983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:41.069118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 332/661] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:40 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:41.071108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:41.071590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:41.072063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:41.201478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:41.210784 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:41.212264 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:41.213422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bf6da3f0-c2e1-4e97-b70e-75892a80a022 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.157538 Oct 11 13:32:41.213982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 330/662] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:41 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:41.298450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:41.299062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:41.305747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:41.306233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:41.306670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:41.307359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:41.307814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:41.308281 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:41.441064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:41.448988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a62cce7e-a4d6-4d91-a8e6-45a3c011283c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.156181 Oct 11 13:32:41.449554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 333/663] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:41 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:42.095249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:42.095835 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:42.103085 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.103573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.104004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.104721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.105167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.105591 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.239002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:42.239585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:42.246134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:42.246563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.247047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.247485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.248218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.248653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.249078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.254993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2941adcb-a45c-4da2-a905-8a950c38e61f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.165276 Oct 11 13:32:42.255752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:42 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:42.378153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:42.386828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:42.388279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:42.389741 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-520ddd88-903c-4e65-9a25-b900b6390b29 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.154685 Oct 11 13:32:42.390309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 334/665] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:42 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:42.474805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:42.475797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:42.485368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.485843 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.486271 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.486982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:42.487404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:42.487824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:42.623014 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:42.631136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bf19ded3-43d3-4625-a68c-0a3de0569f4c tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.162899 Oct 11 13:32:42.631646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 332/666] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:42 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:43.279157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:43.279870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:43.286573 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.287144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.287650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.288467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.288961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.289473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.424384 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:43.424938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:43.431610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:43.431844 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.432357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.432793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.433485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.433936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.434353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.440164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-55ea254f-0028-4230-80ce-51a5487da02b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.164915 Oct 11 13:32:43.440752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 335/667] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:43 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:43.563831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:43.573467 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:43.574973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:43.576646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-74135d93-2abd-4930-8961-e48f3ed8804e tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.156130 Oct 11 13:32:43.577512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 333/668] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:43 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:43.657870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:43.658584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:43.666109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.666677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.667189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.668016 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:43.668593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:43.669097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:43.806723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:43.815067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8f9f666b-fb99-4c24-aff4-0e04d75454f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.163052 Oct 11 13:32:43.815568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 336/669] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:43 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:44.466316 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:44.466894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:44.474178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.474674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.475115 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.475806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.476308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.476732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.607620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:44.608340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:44.611020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:44.615025 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.615453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.615885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.616625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.617077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.617496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.621006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-284fe628-b530-447a-a453-c72cae0f83ac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.158702 Oct 11 13:32:44.621925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:44 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:44.750981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:44.760232 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:44.761742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:44.762903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b831616f-7dba-498c-ae3c-07208a33d7ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.159933 Oct 11 13:32:44.763454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 337/671] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:44 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:44.838899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:44.839519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:44.845807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.846302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.846742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.847440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:44.847897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:44.848354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:44.977456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:44.986998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-81df9825-b147-4ee3-a138-c75b213290f7 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.152580 Oct 11 13:32:44.987602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 335/672] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:44 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:45.647155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:45.647856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:45.651103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:45.652031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:45.660437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:45.661110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:45.661751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:45.662714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:45.663356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:45.663941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:45.685664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:45.789472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:45.790050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:45.792556 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:45.798092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:45.798627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:45.799049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:45.799746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:45.800225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:45.800652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:45.810931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:45.819292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-53ce1d84-a465-4912-9181-bd70ec8527aa tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.177607 Oct 11 13:32:45.819884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 338/673] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:45 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:45.931710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:45.940848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:45.942387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:45.943624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-772bf453-80ca-4748-ad50-b17608b3da15 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.158058 Oct 11 13:32:45.944408 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 336/674] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:45 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:46.013598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:46.014939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:46.025501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.026303 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.027045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.028189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.028971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.029680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.163171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:46.174577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-19dcb37e-e656-43e5-b497-e517efee48aa tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.167193 Oct 11 13:32:46.175214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 339/675] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:46 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:46.747577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6f96bf-d771-4540-929b-a86b306ce1e7", "name": "network-vif-plugged", "status": "completed", "tag": "379734d2-01aa-4233-b661-12929a925cb1"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:46.761313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.762006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.762658 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.768036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:46.776303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] Creating event network-vif-plugged:379734d2-01aa-4233-b661-12929a925cb1 for instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 on hv-cinder-85061 Oct 11 13:32:46.782209 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-198ad650-4b8e-4fee-b2cf-fd8eb7901134 req-3829f4f9-396f-42b4-86d9-1833db9f5beb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039108 Oct 11 13:32:46.783470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 337/676] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:46.842584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:46.843184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:46.849763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.850243 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.850754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.851464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.851952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.852397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.981350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:46.981875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:46.982060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:46.991223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.991557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.992036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:46.992877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:46.993015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e81f60ef-ecad-445e-9e35-a200aef56a1a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.154150 Oct 11 13:32:46.993383 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:46.993557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 340/677] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:46 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:46.993871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:47.129409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:47.139312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:47.140861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:47.142020 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7ffc991c-187f-4bf3-b262-0c6c3be6e412 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.166907 Oct 11 13:32:47.142572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 338/678] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:46 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:47.197521 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:47.198228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:47.204651 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:47.205133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:47.205568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:47.206356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:47.206814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:47.207239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:47.340299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:47.348229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ca5e92e3-830d-4511-87b6-dd43854933f2 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.154548 Oct 11 13:32:47.348804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 341/679] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:47 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:48.021161 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:48.022128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:48.026079 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=54 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:32:48.034924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.035406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.035842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.036561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.037007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.037429 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.167619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:48.168286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:48.175073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.175564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.175962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.176746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.177187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.177601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.179444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:48.188031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-781763b1-85f0-4b09-a559-24a2218f3e3f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.173817 Oct 11 13:32:48.189935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 339/680] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:48 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:48.313496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:48.322539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:48.323982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:48.325168 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b2a88297-b8f5-47eb-9909-063a1e1aabef tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.161661 Oct 11 13:32:48.325738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 342/681] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:48 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:48.379213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:48.379817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:48.386194 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.386674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.387110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.387768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:48.388285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:48.388708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:48.533580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:48.541523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ff9d9b4d-fe8e-4bfe-8de8-c55dfd519318 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1319 microversion: 2.1 time: 0.166333 Oct 11 13:32:48.542105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 340/682] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:48 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:49.214939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:49.215935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:49.227283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.228077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.228850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.230001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.230748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.231456 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.352172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:49.352822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:49.359315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.359797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.360228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.361139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.361738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.362306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.379252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:49.391401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e2cbcaa7-8c6f-4894-8c26-30ec60bd91b8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.181566 Oct 11 13:32:49.398166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 343/683] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:49 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:49.501780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:49.511231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:49.512693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:49.514156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d375c6f1-d91e-4309-90e3-a037a7232933 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.166495 Oct 11 13:32:49.514733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 341/684] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:49 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:49.564458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:49.565044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:49.571312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.571810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.572269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.572974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.573421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.573838 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.701179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:49.712534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2ef31a4e-848e-439d-9e1b-701bbf609fa8 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1508 microversion: 2.1 time: 0.151908 Oct 11 13:32:49.713175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 344/685] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:49 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:49.734954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29faed8e-d660-46aa-a248-25aa2bb120a6", "device": "/dev/sdb"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:49.737903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:49.744010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.744522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.744950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:49.745626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:49.746073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:49.746490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.136424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4365fd30-9d4b-4945-a48d-6ada47c1804e tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "POST /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405233 Oct 11 13:32:50.137050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 342/686] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:32:49 2022] POST /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:50.418485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:50.419014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:50.425835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:50.426309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:50.426737 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.427421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:50.427863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:50.428333 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.540302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:50.541089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:50.547537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:50.548037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:50.548484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.549184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:50.549640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:50.550055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.571830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:50.580565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1338c979-4668-4086-ba70-8895942299c5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.165932 Oct 11 13:32:50.581149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 345/687] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:50 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:50.692139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:50.703286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:50.705130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:50.706516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c454f792-0364-4f68-a319-6d3489c9918c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.171286 Oct 11 13:32:50.707304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 343/688] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:50 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:50.748103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "name": "network-vif-plugged", "status": "completed", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:32:50.757844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:50.758315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:50.758818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:50.770415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] Creating event network-vif-plugged:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:32:50.775395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-18dbe433-7372-4ce4-ade7-9c8aeb51b14d req-f3a76d0c-ae5c-4ab2-9b24-aeacf5611e12 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031174 Oct 11 13:32:50.776061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 346/689] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:32:51.607406 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:51.608050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:51.615340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:51.615858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:51.616332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:51.617029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:51.617453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:51.617909 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:51.735440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:51.736102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:51.742705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:51.743202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:51.743631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:51.744360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:51.744832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:51.745236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:51.761502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:51.770318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-66abd636-96a3-4723-a1a8-d8b2fd132c30 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.167025 Oct 11 13:32:51.770887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 344/690] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:51 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:51.875611 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:51.885487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:51.886717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:51.887989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3735c169-4b83-422f-826f-0653e6b3babb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.157413 Oct 11 13:32:51.889201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 347/691] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:51 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:52.798237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:52.799247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:52.810173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:52.810962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:52.811683 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:52.812875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:52.813632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:52.814335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:52.913058 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:52.913616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:52.920399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:52.920874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:52.921303 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:52.921987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:52.922431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:52.922852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:52.944477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:52.952992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6c53f0f7-6c6a-4722-a0bf-19557b6cafc4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.161434 Oct 11 13:32:52.953526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 345/692] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:52 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:53.051839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:53.061476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:53.062951 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:53.064135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-14753a45-c112-4aac-b1f5-b6f66bd7e10c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1808 microversion: 2.20 time: 0.154993 Oct 11 13:32:53.064714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 348/693] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:52 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:32:53.977454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:53.978094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:53.984754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:53.985231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:53.985662 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:53.986381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:53.986828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:53.987241 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:54.089868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:54.090468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:54.096968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:54.097459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:54.097879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:54.098781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:54.099236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:54.099782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:54.117866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:54.126350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2f4def6e-05f0-4aea-8cc9-ebc33ae3f19b tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.153006 Oct 11 13:32:54.126906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 346/694] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:53 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:54.455343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:54.464231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:54.465711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:54.466867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3d2e4bfc-334e-4e44-b7e1-2f937b2cc515 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1795 microversion: 2.20 time: 0.381138 Oct 11 13:32:54.467424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 349/695] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:32:54 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1795 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:32:55.151728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:55.152477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:55.160710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:55.161341 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:55.161868 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:55.162860 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:55.163398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:55.163894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:55.305981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:55.315127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-499f513e-eada-4262-87b2-bab62b29ec07 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.167996 Oct 11 13:32:55.315703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 347/696] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:55 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:56.342998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:56.344041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:56.352870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:56.353612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:56.354049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:56.354753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:56.355204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:56.355628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:56.486959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:56.497920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d7b4b227-ed64-4ac8-ab62-fa7f1be7bba7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.161581 Oct 11 13:32:56.498489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 350/697] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:56 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:57.526803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:57.527447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:57.534158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:57.534641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:57.535081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:57.535765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:57.536289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:57.536715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:57.674516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:57.683451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-aad0ee21-358d-4ecd-b8ea-149c2fa90b87 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.160553 Oct 11 13:32:57.684009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 348/698] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:57 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:58.707201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:58.709071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:58.716092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:58.716973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:58.717584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:58.718454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:58.719117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:58.719856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:58.856048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:32:58.865100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-26ad3ca1-1218-4000-8f84-ce0aa04eb502 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.162391 Oct 11 13:32:58.865673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 351/699] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:58 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:32:59.888252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:32:59.889314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:32:59.895991 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:59.896570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:59.897030 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:32:59.897708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:32:59.898169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:32:59.898595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:00.037735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:00.046169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-30bbfa1b-d0e9-4c90-8e76-26f1726a5172 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.161752 Oct 11 13:33:00.046741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 349/700] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:32:59 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:01.072900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:01.073889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:01.084454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:01.084933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:01.085367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:01.086055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:01.086505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:01.086927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:01.220553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:01.229114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-84d3750f-7257-40c1-9a35-80a7587928cd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.162806 Oct 11 13:33:01.229682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 352/701] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:01 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:02.254110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:02.254698 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:02.261669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:02.262157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:02.262602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:02.263287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:02.264092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:02.264557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:02.408395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:02.417497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b50487b5-927e-4aed-9ccd-4dfad08cbb59 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.167388 Oct 11 13:33:02.418064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 350/702] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:02 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:03.442454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:03.443201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:03.451487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:03.452084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:03.452657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:03.453507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:03.454070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:03.454570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:03.599958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:03.613275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-09f67963-77c5-4ad9-b9b9-c0c27287dbe9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.175347 Oct 11 13:33:03.614085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 353/703] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:03 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:04.638331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:04.639402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:04.647403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:04.648070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:04.648641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:04.649461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:04.650006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:04.650504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:04.783130 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:04.791725 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e9e26691-d772-4143-8f5c-61a148137408 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1737 microversion: 2.1 time: 0.157946 Oct 11 13:33:04.792289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 351/704] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:04 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:05.819104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:05.820179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:05.831119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:05.831919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:05.832848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:05.834064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:05.834839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:05.835621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:05.967311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:05.976202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2d5b261e-62fb-4f0f-aa5c-f9e0b51a1ddd tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1717 microversion: 2.1 time: 0.163680 Oct 11 13:33:05.976929 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 354/705] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:05 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:06.040779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:06.041301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:06.047984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.048504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.048937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.049616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.050060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.050476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.137804 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] HTTP exception thrown: Cannot 'detach_volume' instance 8920d883-8c41-45a3-bcd1-06959e5be7cb while it is in vm_state rescued Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Request method failure captured: Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments/aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf HTTP/1.1 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW86WkXZFFRXybGXfjtMsJAfkQa63WbdzIDE7vOsnNzhefqC3u9dLr0PwBz_QNwLRJ_QvPtrrH9YzIgqaXzvCzS4Qag21J41-2hA5KXSNUYi2AJfMonufwXe4fkAxaG0kEWNhu_ykK-VDIHDelxlP2geuUDJ-7vJvVOp7hawt7TnZqM Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:33:06.139743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}] Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b50f86c6209f4a728cf3681a7d0a6765 Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:33:06.141113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Cannot 'detach_volume' instance 8920d883-8c41-45a3-bcd1-06959e5be7cb while it is in vm_state rescued Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'server_id': '8920d883-8c41-45a3-bcd1-06959e5be7cb', 'id': 'aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf'} Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:33:06.141840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8920d883-8c41-45a3-bcd1-06959e5be7cb while it is in vm_state rescued Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8920d883-8c41-45a3-bcd1-06959e5be7cb while it is in vm_state rescued Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:06.143742 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Returning 409 to user: Cannot 'detach_volume' instance 8920d883-8c41-45a3-bcd1-06959e5be7cb while it is in vm_state rescued {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:33:06.144803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-17a11063-9177-43bf-afcb-9bd7f729d4c4 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments/aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf" status: 409 len: 152 microversion: 2.1 time: 0.104734 Oct 11 13:33:06.144803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 352/706] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:33:06 2022] DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments/aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 13:33:06.150449 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:06.150985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:06.157372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.157830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.158272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.158963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.159414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.159841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.187040 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:06.228637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e7fc9c94-af3d-4b98-a258-73ce843c7e6a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/action" status: 202 len: 0 microversion: 2.1 time: 0.081872 Oct 11 13:33:06.232461 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 355/707] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:33:06 2022] POST /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:33:06.238883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:06.239395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:06.247049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.247502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.247937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.248670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:06.249137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:06.249695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:06.254510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:06.408913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:06.417380 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e289c953-d5f4-435a-a0ea-423af827c9f9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.183611 Oct 11 13:33:06.417941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 353/708] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:06 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:07.442192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:07.442906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:07.449238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:07.449717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:07.450154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:07.450836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:07.451287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:07.451704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:07.598062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:07.607872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-df3c8f97-d4ac-4fd1-88f8-46a6b16dfc81 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.170564 Oct 11 13:33:07.608444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 356/709] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:07 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:08.631460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:08.632070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:08.639517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:08.640005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:08.640474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:08.641168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:08.641621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:08.642049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:08.780596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:08.789090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b6badfb5-b098-4a04-ac1d-fc27e67e0f48 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.161608 Oct 11 13:33:08.789681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 354/710] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:08 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:09.816994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:09.818084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:09.826269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:09.826755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:09.827199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:09.827892 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:09.828411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:09.828839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:09.968290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:09.977133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f34c7281-8961-4eb3-bd8d-5cdb3ac878dc tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.166815 Oct 11 13:33:09.977710 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 357/711] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:09 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:11.003659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:11.004572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:11.014616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:11.015302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:11.015926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:11.016965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:11.017583 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:11.018224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:11.151932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:11.160623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8956679f-23f7-4afb-96ce-82a7ec03edc3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.162747 Oct 11 13:33:11.161195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 355/712] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:10 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:12.184922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:12.185538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:12.187962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=52 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:12.194044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:12.194883 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:12.195652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:12.196442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:12.197005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:12.197371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:12.355721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:12.367830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-eda46e23-8053-4596-9bff-6377f58a30a9 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.187029 Oct 11 13:33:12.368726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 358/713] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:12 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:13.399008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:13.399921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:13.410700 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:13.411509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:13.412298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:13.413444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:13.414211 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:13.414926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:13.547695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:13.559401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-60e98ae5-9fd9-40c1-bcb5-656ebe23f7da tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1725 microversion: 2.1 time: 0.167027 Oct 11 13:33:13.560290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 356/714] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:13 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:14.592690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:14.593312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:14.600355 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:14.600846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:14.601282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:14.603369 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:14.603854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:14.604313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:14.740099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:14.748748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0408cb01-04a3-4180-a7c6-345b5c3af938 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1731 microversion: 2.1 time: 0.165559 Oct 11 13:33:14.749333 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 359/715] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:14 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:14.772602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:14.773116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:14.779708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:14.780216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:14.780657 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:14.781342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:14.781792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:14.782213 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:14.866577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e9dbffe4-a0b7-471b-945d-4948459ef659 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097879 Oct 11 13:33:14.867148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 357/716] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:33:14 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:33:15.839540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:15.849725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:15.850191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:15.850617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:15.862453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] Creating event network-changed:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:33:15.867735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-fd117ef3-0367-496f-8f3d-7a20010761a1 req-66c2ff92-67ee-45b0-a7b2-ab1444a380cc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095628 Oct 11 13:33:15.868705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 360/717] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:15.966580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:15.967101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:15.973224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:15.973723 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:15.974157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:15.974859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:15.975307 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:15.975789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:16.066180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lazy-loading 'services' on Instance uuid 8d6f96bf-d771-4540-929b-a86b306ce1e7 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:33:16.155872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8b106380-08b0-4957-8c3b-40056d3b3b6d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7/os-volume_attachments/29faed8e-d660-46aa-a248-25aa2bb120a6" status: 202 len: 0 microversion: 2.1 time: 0.193545 Oct 11 13:33:16.157090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 358/718] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:33:15 2022] DELETE /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7/os-volume_attachments/29faed8e-d660-46aa-a248-25aa2bb120a6 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:33:17.284712 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:17.285292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:17.291857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:17.292387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:17.292821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:17.293504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:17.293936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:17.294353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:17.319347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:33:17.400473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6dd3cc80-b458-4d38-9dd4-50c5d9c89404 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 204 len: 0 microversion: 2.1 time: 0.120028 Oct 11 13:33:17.401238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 361/719] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:33:17 2022] DELETE /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:33:17.411505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:17.412368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:17.418629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:17.419193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:17.419630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:17.420347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:17.420959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:17.421384 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:17.561285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:17.570402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-52be8240-3aec-4efe-97be-8badaeb491de tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1514 microversion: 2.1 time: 0.164188 Oct 11 13:33:17.570975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 359/720] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:17 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:33:17.888070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:17.899102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:17.899616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:17.900082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:17.912459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] Creating event network-changed:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:33:17.918072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-affe2e4f-107c-4e93-9751-23b7980ebd4b req-36b62f5b-d3b2-42be-a160-a75b64fe363f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 Oct 11 13:33:17.918625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 362/721] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:33:18.596614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:18.597412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:18.601061 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=42 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:18.607540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:18.608022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:18.608480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:18.609178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:18.609666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:18.610091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:18.747304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:18.755279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9cd37f64-b669-4add-9040-c4850d1a2212 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1514 microversion: 2.1 time: 0.164816 Oct 11 13:33:18.755838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 360/722] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:18 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:19.781262 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:19.781961 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:19.788529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:19.788981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:19.789667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:19.790569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:19.791237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:19.791889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:19.923346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:19.931472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8d3b171e-60ca-4695-85b6-b5433df85124 tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1514 microversion: 2.1 time: 0.155182 Oct 11 13:33:19.932518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 363/723] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:19 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:20.257200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d6f96bf-d771-4540-929b-a86b306ce1e7", "name": "network-vif-deleted", "tag": "379734d2-01aa-4233-b661-12929a925cb1"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:33:20.268043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:20.268582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:20.269003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:20.280411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] Creating event network-vif-deleted:379734d2-01aa-4233-b661-12929a925cb1 for instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 on hv-cinder-85061 Oct 11 13:33:20.285472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-ceac42d4-8d6f-4384-99c8-424d8e5c9f87 req-0ddc5361-1fdc-4553-9794-f4153f30b53b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031998 Oct 11 13:33:20.286061 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 361/724] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:33:20.955298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:20.955953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:20.964289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:20.965433 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:20.966124 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:20.966912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:20.967470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:20.968041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:21.003767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:21.004262 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:21.004731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:21.005172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lazy-loading 'fault' on Instance uuid 8d6f96bf-d771-4540-929b-a86b306ce1e7 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:33:21.046442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b6993791904a50a94ba0f980c9c0c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192799a3ba9a4c0e981f6813a0341768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:33:21.054325 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f5eeb8f7-c2fc-4f81-a047-8d1ce0972d4a tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 200 len: 1309 microversion: 2.1 time: 0.103070 Oct 11 13:33:21.054901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 364/725] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:20 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:33:22.079148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:22.080137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] [instance: 8d6f96bf-d771-4540-929b-a86b306ce1e7] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:22.087190 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:22.087870 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:22.088634 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:22.089866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:22.090437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:22.090922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:22.104644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] HTTP exception thrown: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Request method failure captured: Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 HTTP/1.1 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXAFyJ1EhZYsO5or-ppkLtKa_G_ho4XScPH6IdXQP2ZSnVJaJvjuvqkNPfa3u5eVtWVnYsuJcRyicwppPIRZ_eQXXZ4a0OSsgb9bvJGD2W1hhRCdGqLDkgDUBQ_mbw922CR4Avay6WnpOl1XJ1PqdcsSma3Z8IEZIYR7igvoSAt8_ek Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 192799a3ba9a4c0e981f6813a0341768 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:33:22.106454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/192799a3ba9a4c0e981f6813a0341768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/192799a3ba9a4c0e981f6813a0341768"}]}] Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 192799a3ba9a4c0e981f6813a0341768 Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742068844 Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesSnapshotTestJSON-742068844-project Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 71b6993791904a50a94ba0f980c9c0c6 Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesSnapshotTestJSON-742068844-project Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. Oct 11 13:33:22.108033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '8d6f96bf-d771-4540-929b-a86b306ce1e7'} Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:33:22.108846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. Oct 11 13:33:22.110053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:33:22.111181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] Returning 404 to user: Instance 8d6f96bf-d771-4540-929b-a86b306ce1e7 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:33:22.111181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-36d1724c-5c2d-4c61-982c-beafe6c9469d tempest-VolumesSnapshotTestJSON-742068844 tempest-VolumesSnapshotTestJSON-742068844-project] 10.222.0.15 "GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7" status: 404 len: 111 microversion: 2.1 time: 0.034501 Oct 11 13:33:22.111181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 362/726] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:33:22 2022] GET /compute/v2.1/servers/8d6f96bf-d771-4540-929b-a86b306ce1e7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:33:59.609189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:59.609984 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:33:59.836347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:33:59.836842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:33:59.842967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:59.843447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:59.843884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:59.844605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:33:59.845068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:33:59.845484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:33:59.981377 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lazy-loading 'services' on Instance uuid 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:00.095605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e254900c-c39d-4b4c-9766-76ed5210fee6 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments/362fe510-f5bd-4bb4-b023-5486adfab0b9" status: 202 len: 0 microversion: 2.1 time: 0.491396 Oct 11 13:34:00.096280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 365/727] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:33:59 2022] DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments/362fe510-f5bd-4bb4-b023-5486adfab0b9 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:01.236251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:01.238799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=5 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:01.239438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:01.246278 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:01.246773 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:01.247248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:01.270203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Going to try to stop instance {{(pid=118881) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 13:34:01.315450 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5a4f7b47-2a26-43ed-8b4c-f3a5b36e36c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action" status: 202 len: 0 microversion: 2.1 time: 0.083040 Oct 11 13:34:01.316062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 363/728] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:34:01 2022] POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:01.325390 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:01.326100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:01.332920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:01.333378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:01.333805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:01.334500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:01.334952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:01.335367 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:01.472734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:01.480590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dfdd1581-9970-4169-bf88-6b977437d34b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.160044 Oct 11 13:34:01.481195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 366/729] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:01 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:02.518927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:02.520062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:02.530703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:02.531221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:02.531660 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:02.532395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:02.532853 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:02.533272 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:02.671794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:02.682454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6eeda8f8-0806-44b3-a6cd-a67672a1115f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.171762 Oct 11 13:34:02.683232 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 364/730] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:02 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:03.708158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:03.708945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:03.717455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:03.718063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:03.718603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:03.719475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:03.720044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:03.720608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:03.860151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:03.868284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ae1cf45a-9f1e-4cbd-b820-70a72404b85c tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.165160 Oct 11 13:34:03.868859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 367/731] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:03 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:04.904064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:04.905047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:04.913494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:04.914100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:04.914672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:04.915531 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:04.916095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:04.916659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:05.060901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:05.069424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3d710d08-64d3-4af8-a0b1-5f353d224ad7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.172003 Oct 11 13:34:05.069989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 365/732] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:04 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:06.096387 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:06.097455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:06.108261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:06.108748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:06.109188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:06.109881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:06.110340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:06.110766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:06.247970 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:06.256074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-93545acc-68d4-46a4-bf9d-e3f482a45547 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.166163 Oct 11 13:34:06.256682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 368/733] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:06 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:07.284101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:07.285050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:07.295786 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:07.296686 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:07.297415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:07.298558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:07.299322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:07.300026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:07.439347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:07.447428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d5ed5527-e9b4-4323-bbe4-e1db4fe7e855 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.170080 Oct 11 13:34:07.448050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 366/734] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:07 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:08.483313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:08.484356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:08.491788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:08.492299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:08.492734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:08.493423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:08.493876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:08.494300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:08.626110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:08.634278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7b87358a-3814-42e2-a747-21d4e30568ba tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.157519 Oct 11 13:34:08.634856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 369/735] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:08 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:09.661721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:09.662512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:09.665089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:34:09.665291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Tue Oct 11 13:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a (ip 10.222.0.15) !!! Oct 11 13:34:09.673906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:09.674492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:09.675021 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:09.675880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:09.676463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:09.676988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:09.813181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:09.821555 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8fe9ffd5-41bf-4484-95e0-f05276448e25 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.165708 Oct 11 13:34:09.822131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 367/736] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:09 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:10.850711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:10.851627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:10.855305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:34:10.855610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Tue Oct 11 13:34:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a (ip 10.222.0.15) !!! Oct 11 13:34:10.864870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:10.865354 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:10.865789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:10.866483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:10.866936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:10.867357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:11.007796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:11.019585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0bb2d0a3-6391-490a-81fa-13e0fd0dbd48 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.175414 Oct 11 13:34:11.020301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 370/737] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:10 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:12.048223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:12.048825 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:12.056786 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:12.057266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:12.057700 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:12.058391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:12.058838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:12.059262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:12.214914 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:12.226111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2adc1425-975a-4a68-86e3-1b455e194e1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.181850 Oct 11 13:34:12.226936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 368/738] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:12 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:13.254672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:13.255244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:13.262496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:13.263337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:13.263769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:13.264501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:13.264954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:13.265376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:13.399258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:13.407717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2285bd31-123f-4bf6-bcd3-152a74b41b4f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.157371 Oct 11 13:34:13.408321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 371/739] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:13 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:14.206817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:14.207762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:14.218563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.219356 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.220092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.221286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.222051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.222938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.251572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-95409306-b228-4ac6-8b71-42123e1fccaf tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments/644a7cdc-ff51-4cf9-82d7-22f3dcf56c57" status: 200 len: 194 microversion: 2.20 time: 0.051433 Oct 11 13:34:14.252148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 369/740] 10.222.0.15 () {60 vars in 1454 bytes} [Tue Oct 11 13:34:14 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments/644a7cdc-ff51-4cf9-82d7-22f3dcf56c57 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:14.322116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:14.322635 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:14.329378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.329855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.330284 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.330964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.331406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.331822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.421455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lazy-loading 'services' on Instance uuid fe7af4bf-c080-41e5-8b2d-e0a639122ad1 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:14.437988 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:14.438673 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:14.445224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.445719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.446200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.446906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.447283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.447728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.498203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7fa3afc4-617b-4a16-8b49-fdd76158efed tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments/644a7cdc-ff51-4cf9-82d7-22f3dcf56c57" status: 202 len: 0 microversion: 2.20 time: 0.179843 Oct 11 13:34:14.498850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 372/741] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Oct 11 13:34:14 2022] DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments/644a7cdc-ff51-4cf9-82d7-22f3dcf56c57 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:14.507673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:14.510117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:14.516856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.517334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.517769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.518472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:14.518935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:14.519361 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:14.551013 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c377dede-e817-4f5a-a742-a778a13b7196 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047432 Oct 11 13:34:14.551579 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 373/742] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 11 13:34:14 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 13:34:14.593084 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:14.601367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-aaa758b2-9f6d-4bd6-bd48-f6221f2c76f2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.167343 Oct 11 13:34:14.601922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 370/743] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:14 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:15.568540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:15.571526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:15.578136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.578637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.579086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.579804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.580322 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.580784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.611627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4d208f24-c002-47ca-b808-c4f7aa615e6f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049794 Oct 11 13:34:15.612279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 374/744] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 11 13:34:15 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:15.624505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:15.625028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:15.631842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.632479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.632922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.633631 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.634083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.634509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.675187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:15.675682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:15.681691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.682176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.682610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.683331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.683786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.684316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.709990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:15.765473 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:15.773897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1d897931-5953-4367-a33f-7ced52446e5f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.153335 Oct 11 13:34:15.774604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 371/745] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:15 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:15.790172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e92be5a5-5a91-4dd5-8c7e-fa43410bb3b5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 204 len: 0 microversion: 2.20 time: 0.118502 Oct 11 13:34:15.791086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 375/746] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 11 13:34:15 2022] DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:34:15.799275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:15.799877 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:15.806031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.806511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.806950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.807640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:15.808082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:15.808536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:15.955254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:15.963558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:15.965027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:15.966231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c1d9be05-f9aa-496c-adda-0553db38cef9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.170909 Oct 11 13:34:15.966752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 372/747] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:15 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:16.260738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:16.263432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:16.269799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.270292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.270728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.271409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.271854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.272298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.358086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-53c09d78-2bc8-46f9-98ae-f1db07d6618d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action" status: 202 len: 0 microversion: 2.1 time: 0.102132 Oct 11 13:34:16.358705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 376/748] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:34:16 2022] POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:16.367104 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:16.367726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:16.373996 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.374469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.374905 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.375610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.376055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.376515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.521251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:16.530392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bae4e5c5-98f7-494b-8f68-e40d4e9de4b5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1751 microversion: 2.1 time: 0.167339 Oct 11 13:34:16.530961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 373/749] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:16 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:16.803386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:16.804544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:16.811357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.811855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.812342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.813059 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.813534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.813974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.832873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:16.956298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:16.964709 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6184f335-078b-47dc-a12c-840558e6da3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1678 microversion: 2.1 time: 0.169462 Oct 11 13:34:16.965277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 377/750] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:16 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:16.990881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:16.991547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:16.997659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.998145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:16.998579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:16.999364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:16.999779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:17.000227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:17.131499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:17.140353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:17.141824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:17.142984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2aa8184f-6a89-4ad5-8f87-d726e31f4e24 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.155975 Oct 11 13:34:17.143527 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 374/751] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:16 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:17.554204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:17.555074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:17.561384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:17.561994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:17.562517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:17.563296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:17.563734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:17.564192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:17.715037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:17.723696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4c93e45d-a14e-4e76-ad23-05863781d2dc tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1751 microversion: 2.1 time: 0.173501 Oct 11 13:34:17.724643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 378/752] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:17 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:17.991938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:17.992659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:17.999452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:17.999956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.000426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.001117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.001570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.001990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.140424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.148889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-08a96172-6b3d-47a7-a0e5-133107b7db1f tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1655 microversion: 2.1 time: 0.160595 Oct 11 13:34:18.149448 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 375/753] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:17 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:18.169655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:18.170190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:18.171818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:18.177409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.177880 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.178306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.178412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.178865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.178983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.179293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.179406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.179900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.205326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Going to try to start instance {{(pid=118881) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 13:34:18.255682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-146df110-095a-4e81-9ecf-4d2fa694372d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action" status: 202 len: 0 microversion: 2.1 time: 0.087435 Oct 11 13:34:18.256616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 376/754] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:34:18 2022] POST /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:18.265903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:18.266824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:18.280239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.281065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.281401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.282156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.282655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.283128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.305573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:18.331294 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.342844 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.344841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.346184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c645f828-e07f-4340-b187-5d8de0fe6fac tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1723 microversion: 2.20 time: 0.180646 Oct 11 13:34:18.347446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 379/755] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:18 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:18.451306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.461133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3effa68d-b24b-43a6-98a9-12b025493f92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1664 microversion: 2.1 time: 0.199650 Oct 11 13:34:18.462812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 377/756] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:18 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:18.747373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:18.748151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:18.754358 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.755260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.755260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.756062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:18.756584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:18.756982 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:18.900751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:18.909239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-39cd449b-6dc0-4f22-b5a9-2da6ff9bca03 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.165729 Oct 11 13:34:18.909997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 380/757] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:18 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:19.371913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:19.372538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:19.379354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.379841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.380335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.381004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.381460 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.381886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.447486 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:19.456168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:19.457602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:19.458882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-036995c2-1dae-4a4f-8a0c-6480efbdea44 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1656 microversion: 2.20 time: 0.091017 Oct 11 13:34:19.465140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 378/758] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:19 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:19.485085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:19.485837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:19.492635 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.493209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.493712 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.494477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.495011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.495538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.640210 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:19.650612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-184afd3c-be6b-494b-b2b5-cd0c74955cdd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1664 microversion: 2.1 time: 0.168606 Oct 11 13:34:19.652157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 381/759] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:19 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:19.730772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7af4bf-c080-41e5-8b2d-e0a639122ad1", "name": "network-vif-deleted", "tag": "ab810459-67a2-4f80-a97e-cea4471d571b"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:19.747868 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.748386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.749431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.766253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] Creating event network-vif-deleted:ab810459-67a2-4f80-a97e-cea4471d571b for instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 on hv-cinder-85061 Oct 11 13:34:19.774558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-969ac1fa-3be6-42fd-af18-794e47b9b59f req-12f97c16-bf2b-4b02-9791-40ec0de2252e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047263 Oct 11 13:34:19.775689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 379/760] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:19.936077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:19.936824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:19.943721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.944197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.944737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.945793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.946497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.946750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.985001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:19.985506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:19.992377 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.992897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.993509 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:19.994271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:19.996727 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:19.997186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.026690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0d74bda2-545f-415b-8a2e-b499add8c3f8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/ips" status: 200 len: 150 microversion: 2.1 time: 0.183523 Oct 11 13:34:20.027792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 382/761] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:34:19 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/ips => generated 150 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:20.040657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bfe919f-5946-47ce-ad2f-a995195afa3d"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:20.043256 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:20.049447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.049930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.050365 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.051054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.051665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.052266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.138929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.147759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c834dce6-57b5-4a9b-b2c9-2044ed048ba8 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.216992 Oct 11 13:34:20.148922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 380/762] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:19 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:20.175911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: POST /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/os-volume_attachments HTTP/1.1 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 74 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:20.177804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {"volumeAttachment": {"volumeId": "5bfe919f-5946-47ce-ad2f-a995195afa3d"}} Oct 11 13:34:20.179199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'server_id': 'f16d3793-e4d8-4a6b-8cba-9e0e20d70722', 'body': {'volumeAttachment': {'volumeId': '5bfe919f-5946-47ce-ad2f-a995195afa3d'}}} Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:20.180029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:20.181625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 400 to user: Invalid volume: volume 5bfe919f-5946-47ce-ad2f-a995195afa3d is already attached to instances: c2ec8e2f-5c8c-414b-acec-852608b2e0f2 {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:20.182822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ff918015-9d2b-4ddc-b879-433aecde99b3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143654 Oct 11 13:34:20.184060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 383/763] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:34:20 2022] POST /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 13:34:20.189127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:20.189625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:20.196101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.196679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.197108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.197880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.198327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.198746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.391912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:20.476438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-013786a6-7b28-460f-b68c-6b6803035f0d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 204 len: 0 microversion: 2.1 time: 0.290902 Oct 11 13:34:20.477479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 381/764] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:34:20 2022] DELETE /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:20.485165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:20.485680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:20.486200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:20.486772 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:20.492594 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.493233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.493669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.494371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.494822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.495245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.497834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.498517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.498955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.499671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.500151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.505591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.538627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.539135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.539563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.540005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lazy-loading 'fault' on Instance uuid fe7af4bf-c080-41e5-8b2d-e0a639122ad1 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:20.609002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.621832 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.626085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.629097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cba63be8-5e8e-4464-8d0d-0c6841dd2d76 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1372 microversion: 2.20 time: 0.147628 Oct 11 13:34:20.630096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 384/765] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:20 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:20.674761 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:20.674975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.675645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:20.682335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.682925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.683198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f2fd6ad2-b1e9-463c-aa5a-97351949a862 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1681 microversion: 2.1 time: 0.201712 Oct 11 13:34:20.683725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.683847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 382/766] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:20 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:20.684699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:20.685305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:20.685879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:20.819475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:20.828020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a75d5665-c32c-47da-8414-dae87f982af0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1668 microversion: 2.1 time: 0.156890 Oct 11 13:34:20.828644 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 385/767] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:20 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:21.171270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:21.171787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:21.178496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.178993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.179428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.180427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.180898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.181327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.333899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:21.343222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dfdcd50a-378a-4b0b-aa76-59813fd41726 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.176124 Oct 11 13:34:21.343820 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 383/768] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:21 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:21.658788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:21.659796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:21.668474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.668996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.669429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.670120 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.670575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.670999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.701907 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.702383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.702815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.703261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lazy-loading 'fault' on Instance uuid fe7af4bf-c080-41e5-8b2d-e0a639122ad1 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:21.706881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:21.707492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:21.714133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.714618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.715052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.715740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:21.716214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:21.716640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:21.744382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:21.752792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:21.754224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:21.755374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-219155d5-e995-45df-92d3-befd13c4821f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 200 len: 1372 microversion: 2.20 time: 0.103128 Oct 11 13:34:21.755934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 386/769] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:21 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:21.844659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:21.856653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c5d0aa25-6de9-4b40-9e63-d227b568f6a5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1681 microversion: 2.1 time: 0.153426 Oct 11 13:34:21.857400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 384/770] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:21 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:22.366850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:22.367460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:22.373572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.374061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.374502 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:22.375199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.375652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.376080 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:22.752528 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:22.761047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ae9b1e36-5f6f-4ce8-b16f-872f9141b0d0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.398125 Oct 11 13:34:22.761622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 387/771] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:22 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:22.780875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:22.781561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:22.787754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.788261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.788697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:22.789418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.789867 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.790286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:22.803295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 HTTP/1.1 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:22.805158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:34:22.806571 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'fe7af4bf-c080-41e5-8b2d-e0a639122ad1'} Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:22.807362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:34:22.808841 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:22.810170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:22.810170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-81264967-cd6b-463d-bda0-adebabdbc6f8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 404 len: 111 microversion: 2.20 time: 0.029741 Oct 11 13:34:22.810170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 385/772] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:22 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:34:22.815638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b8a11288-55f6-4a53-a37b-cb0e5806af3b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '.version_select at 0x7f7a54f0e820>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:22.839035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b8a11288-55f6-4a53-a37b-cb0e5806af3b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683303466" status: 204 len: 0 microversion: 2.20 time: 0.027147 Oct 11 13:34:22.839625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 388/773] 10.222.0.15 () {60 vars in 1262 bytes} [Tue Oct 11 13:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683303466 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:34:22.880032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:22.881103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:22.887284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.888071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.888722 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:22.889434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:22.889867 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:22.890287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:23.114430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:23.123335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-31fcead1-6f23-405e-b03d-75ef2d81ee72 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1681 microversion: 2.1 time: 0.247155 Oct 11 13:34:23.124293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 386/774] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:22 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:23.490138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16d3793-e4d8-4a6b-8cba-9e0e20d70722", "name": "network-vif-deleted", "tag": "1112479d-152b-4660-a6ed-8584f3470465"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:23.506207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:23.506696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:23.507127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:23.521340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] Creating event network-vif-deleted:1112479d-152b-4660-a6ed-8584f3470465 for instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 on hv-cinder-85061 Oct 11 13:34:23.528940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-988f67b5-c2d6-46f8-98b7-bd467e268438 req-836d652e-09fe-4205-a67d-2121e9846710 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041060 Oct 11 13:34:23.530101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 389/775] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:23.582212 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dbc4b064-a7b4-4308-96d4-8671afe88917 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: .version_select at 0x7f7a55070d30>, body: {"keypair": {"name": "tempest-keypair-565836454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBP2SR/VUi9ApuLfmMHgtzdaRFuY0ctskFwoVv5gffHzDOgzj5WvB22RBlIIp+v/TSGJvnUk20NntqbIQzGc8urgLhsoivQNFWfsdWrBWPO1DfPmcFTn2iMve98KpRmXw=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:23.606849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-dbc4b064-a7b4-4308-96d4-8671afe88917 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:34:23.611035 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-dbc4b064-a7b4-4308-96d4-8671afe88917 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for user d439d54a4f2348d78ddb84691f2a4f63 and project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:34:23.642906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dbc4b064-a7b4-4308-96d4-8671afe88917 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.065357 Oct 11 13:34:23.643948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 387/776] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Oct 11 13:34:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 13:34:23.786481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:23.787274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:23.796735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:23.797476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:23.798110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:23.799485 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:23.800199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:23.800803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:23.981022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:23.990736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9ec8a6e1-6d98-40d7-8ec8-47e9168b4a86 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.208875 Oct 11 13:34:24.007289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 390/777] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:23 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:24.152955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:24.154565 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:24.162462 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:24.163423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:24.164075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:24.165333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:24.166060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:24.166679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:24.203428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:24.204357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:24.205098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:24.205975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'fault' on Instance uuid f16d3793-e4d8-4a6b-8cba-9e0e20d70722 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:24.265855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:24.275438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4ee3c0cd-f101-4b9a-83f6-cf39a72b4b3b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 200 len: 1330 microversion: 2.1 time: 0.130260 Oct 11 13:34:24.276057 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 388/778] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:24 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:25.014603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:25.015794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:25.022018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.022704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.023372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.024291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.024899 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.025500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.099578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1838901447", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ecd09a7-8518-4f60-ba4d-fd1b9214e176"}], "security_groups": [{"name": "tempest-securitygroup--833131848"}], "key_name": "tempest-keypair-565836454", "user_data": "}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:25.197714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:25.206144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bad508c2-ecdf-4c32-bcec-588afaf7f33f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.195613 Oct 11 13:34:25.207054 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 391/779] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:25 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:25.226633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] validate_networks() for [('3ecd09a7-8518-4f60-ba4d-fd1b9214e176', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:34:25.299183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:25.299682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:25.305599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.306083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.306500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.307178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.307636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.308058 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.321813 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 HTTP/1.1 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:25.323500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:34:25.325116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'f16d3793-e4d8-4a6b-8cba-9e0e20d70722'} Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:25.325998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:34:25.327342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:25.329399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:25.329399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8f264906-3638-4504-826e-11a356c10f22 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 404 len: 111 microversion: 2.1 time: 0.029819 Oct 11 13:34:25.329399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 392/780] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:25 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:25.333338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-332a330c-acc4-4b6f-b7f7-26ff56209510 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '.version_select at 0x7f7a54e578b0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:25.352938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-332a330c-acc4-4b6f-b7f7-26ff56209510 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-258022483" status: 202 len: 0 microversion: 2.1 time: 0.022870 Oct 11 13:34:25.353601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 393/781] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 11 13:34:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-258022483 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:34:25.731646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:34:25.732974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:34:25.733543 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:34:25.734011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:34:25.734503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:34:25.744107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.744627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.745083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.746051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:25.746562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:25.746992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:25.764789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:34:25.769370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Getting quotas for user d439d54a4f2348d78ddb84691f2a4f63 and project 33afb7274a9146cdbee0eeb2e6f48785. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:34:25.781195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:34:25.783533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:34:25.835532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b0308521-f72e-4fcd-9a01-9050580be51a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.740169 Oct 11 13:34:25.836517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 389/782] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Oct 11 13:34:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 13:34:25.847527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:25.848513 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:25.908167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:25.916713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:25.918330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:25.919430 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-84b2397c-9c81-4d48-9363-ec06b9ffb4a7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1281 microversion: 2.20 time: 0.075818 Oct 11 13:34:25.920271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 394/783] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:25 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:26.230122 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:26.230780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:26.239070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.239559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.239998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.240738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.241188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.241849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.307274 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:26.307845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:26.314582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.315310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.316000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.316763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.317375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.318021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.399915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:26.402153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'services' on Instance uuid c2ec8e2f-5c8c-414b-acec-852608b2e0f2 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:26.409025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-46a868fe-465f-4b7b-b78a-f2efc51f912d tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.183338 Oct 11 13:34:26.409584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 390/784] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:26 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:26.480912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c8521225-e26f-4538-a066-0ffdea3ea0ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments/5bfe919f-5946-47ce-ad2f-a995195afa3d" status: 202 len: 0 microversion: 2.1 time: 0.177553 Oct 11 13:34:26.481504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 395/785] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:34:26 2022] DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments/5bfe919f-5946-47ce-ad2f-a995195afa3d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:34:26.490357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:26.492883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:26.499476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.500628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.500794 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.501470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.502010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.502601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.534949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5f279375-e51d-499f-9a53-82fed10b91ee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048950 Oct 11 13:34:26.535550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 391/786] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:34:26 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:26.948464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:26.949172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:26.955836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.956377 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.956836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:26.957547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:26.957992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:26.958410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.026183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:27.034864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:27.036711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:27.037816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b68444bb-27e1-4a64-a4b5-dba7356d923d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1333 microversion: 2.20 time: 0.094687 Oct 11 13:34:27.038368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 396/787] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:26 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:27.433702 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:27.434291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:27.441273 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.441759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.442196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.442891 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.443340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.443775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.547652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:27.550152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:27.557953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.558705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.559155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.559901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.560410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.560852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.584177 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:27.605413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:27.615179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6c05faf2-eb27-4099-8cac-a61953e365f3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071844 Oct 11 13:34:27.616163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 397/788] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:34:27 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 13:34:27.617122 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-098d31fd-0a37-4e95-8640-44487e804dd0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.187338 Oct 11 13:34:27.617867 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 392/789] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:27 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:27.686823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:27.687272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:27.693406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.693881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.694313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.694998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.695442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.695904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.722213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:27.807467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-87c20203-7674-47a5-83e9-6e35b953b42d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 204 len: 0 microversion: 2.1 time: 0.122520 Oct 11 13:34:27.811539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 398/790] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:34:27 2022] DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:27.816799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:27.817519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:27.823854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.824430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.824874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.825572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:27.826032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:27.826465 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:27.958468 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:27.966639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3f3522bf-810d-4493-a3db-41222fee605e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1680 microversion: 2.1 time: 0.153878 Oct 11 13:34:27.967218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 393/791] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:27 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:28.064015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:28.064756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:28.071008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:28.071586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:28.072015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:28.072750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:28.073204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:28.073632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:28.136491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:28.144944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:28.146388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:28.147486 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-33e049a2-0f59-4045-b39b-a991ab923722 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1339 microversion: 2.20 time: 0.088187 Oct 11 13:34:28.148046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 399/792] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:28 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:28.645086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:28.645717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:28.653001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:28.653488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:28.653947 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:28.654652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:28.655148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:28.655574 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:28.805812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:28.814446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7510075c-8f85-4856-bafb-3dbf8f47907e tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1756 microversion: 2.1 time: 0.173282 Oct 11 13:34:28.815036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 394/793] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:28 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:28.990183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:28.991572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:29.002994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.003487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.003920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.004725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.005176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.005585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.138224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:29.148447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-47142171-b588-4f4c-b73f-8ce1e1a2d1b9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1680 microversion: 2.1 time: 0.162137 Oct 11 13:34:29.149053 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 400/794] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:28 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:29.172798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:29.173411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:29.176486 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:29.180405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.180895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.181330 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.182026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.182476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.182888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.188402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:29.294946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:29.305817 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.306381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.306876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.318376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] Creating event network-changed:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:34:29.322789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:29.323829 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-a8ee3462-c018-493e-b1d9-56a1aeddf480 req-3e5a40fa-1f84-4ab3-ae51-25b2e55dd1d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032706 Oct 11 13:34:29.324789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 401/795] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:34:29.331667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:29.333180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:29.334304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-87fbd56c-ed5e-4285-b0a7-1012d058a336 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.165557 Oct 11 13:34:29.334854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 395/796] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:29 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:29.838605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:29.839760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:29.841545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:29.847601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.848190 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.848652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:29.849383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:29.849861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:29.850270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.064610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:30.081033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d13d792e-dcaa-4346-a4d4-4b07746289c7 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1759 microversion: 2.1 time: 0.246720 Oct 11 13:34:30.101105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 402/797] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:29 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:30.170984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:30.171574 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:30.178174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:30.179058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:30.179696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.180751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:30.181424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:30.182094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.232888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:30.233378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:30.233809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.234250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'fault' on Instance uuid c2ec8e2f-5c8c-414b-acec-852608b2e0f2 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:30.284436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:30.292695 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1cc1c7cf-d16c-4db7-b777-00338478cdc5 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1332 microversion: 2.1 time: 0.125621 Oct 11 13:34:30.293262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 396/798] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:30 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:30.360862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:30.361497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:30.368437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:30.369140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:30.369763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.371028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:30.371659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:30.372741 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:30.519610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:30.528407 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:30.529939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:30.531178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-37e6a6b2-aff7-45cb-972b-939ba7669197 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.175505 Oct 11 13:34:30.531811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 403/799] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:30 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:31.321168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:31.321771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:31.329767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.330350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.330863 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.331680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.332243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.332738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.345532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ec8e2f-5c8c-414b-acec-852608b2e0f2", "name": "network-vif-deleted", "tag": "0831c3f5-2c69-4990-9a5e-7debdae49aaf"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:31.356725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.357198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.357627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.366199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.366678 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.367131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.367596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'fault' on Instance uuid c2ec8e2f-5c8c-414b-acec-852608b2e0f2 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:31.369736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] Creating event network-vif-deleted:0831c3f5-2c69-4990-9a5e-7debdae49aaf for instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 on hv-cinder-85061 Oct 11 13:34:31.374993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-9fec995f-6fd7-49c3-8472-b4022b26d958 req-7a2f7db2-9e0d-46fc-95b5-2ed1ca5c49e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033851 Oct 11 13:34:31.375592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 404/800] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:31.408050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:31.416456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9d703813-2e02-438f-aa15-21763c84ca00 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1332 microversion: 2.1 time: 0.102126 Oct 11 13:34:31.416994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 397/801] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:31 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:31.562431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:31.563977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:31.575061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.575751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.576535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.577671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:31.578419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:31.579119 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:31.714882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:31.723220 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:31.724688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:31.725793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5ebe1cf2-d243-43f4-baa6-0c9cbe7fe332 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.171443 Oct 11 13:34:31.726395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 405/802] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:31 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:32.442619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:32.443677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:32.454726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.455545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.456311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.457502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.458327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.459053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.491549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.492036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.492600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.493050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'fault' on Instance uuid c2ec8e2f-5c8c-414b-acec-852608b2e0f2 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:32.541126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:32.549240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d2988c32-d985-4b52-978b-b316c90e5765 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 200 len: 1332 microversion: 2.1 time: 0.113190 Oct 11 13:34:32.549829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 398/803] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:32 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:32.738680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:32.739181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:32.745839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.746302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.746730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.747418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.747869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.748335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.756387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:32.757136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:32.764095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.764615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.765058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.765753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.766744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.766744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.835275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'services' on Instance uuid 8920d883-8c41-45a3-bcd1-06959e5be7cb {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:32.906203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:32.915541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:32.915769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d1df930e-7f91-4561-97a8-736d83b9de49 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments/aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf" status: 202 len: 0 microversion: 2.1 time: 0.180722 Oct 11 13:34:32.916450 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 406/804] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:34:32 2022] DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments/aaf744f2-e6e7-45b0-ad15-2f6dc9be5cdf => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:32.917698 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:32.918938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-351130c6-92be-45c1-bced-fd4f647712e9 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.166729 Oct 11 13:34:32.932556 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 399/805] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:32 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:32.938470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:32.941067 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:32.947499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.947991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.948475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.949176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:32.949638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:32.950070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:32.979381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a4a52e3c-4b1c-46b2-a373-a19b4d29b2e8 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Oct 11 13:34:32.979933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 407/806] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:34:32 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:34:33.572160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:33.572680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:33.579110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:33.579598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:33.580072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:33.580810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:33.581304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:33.581733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:33.595610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 HTTP/1.1 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:33.597202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:34:33.599007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'c2ec8e2f-5c8c-414b-acec-852608b2e0f2'} Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:33.599883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:34:33.601464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:33.602848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:33.602848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e6f2a502-3b32-4332-b5a3-02af53caf804 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 404 len: 111 microversion: 2.1 time: 0.031076 Oct 11 13:34:33.602848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 400/807] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:33 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:33.608055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-602b8eed-424f-43a0-9c2b-fec63cb97a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '.version_select at 0x7f7a54fa1550>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:33.628849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-602b8eed-424f-43a0-9c2b-fec63cb97a12 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203257421" status: 202 len: 0 microversion: 2.1 time: 0.024936 Oct 11 13:34:33.629404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 408/808] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 11 13:34:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203257421 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:33.944922 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:33.945562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:33.951585 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:33.952331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:33.952735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:33.953434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:33.953879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:33.954299 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:33.992167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:33.994689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:34.002308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.002828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.003746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.004547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.005088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.005577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.036555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e97ffb50-4df2-41c5-9877-52da4d0a6c6e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048911 Oct 11 13:34:34.038269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 409/809] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:34:33 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:34:34.094878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:34.103668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:34.107740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:34.107740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-413e201b-7cb9-4fa5-9021-017ad8ccbd56 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.165647 Oct 11 13:34:34.107740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 401/810] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:33 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:34.133522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:34.134062 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:34.140910 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.141389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.141841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.143164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.143631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.144053 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.169837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:34.257742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-125f882b-e145-405c-9ef3-959ef19015ed tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 204 len: 0 microversion: 2.1 time: 0.127800 Oct 11 13:34:34.258920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 410/811] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:34:34 2022] DELETE /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:34.270762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:34.271385 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:34.275568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d60be667-a487-49c0-9b9c-9249b7240140 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: .version_select at 0x7f7a54f0e820>, body: {"keypair": {"name": "tempest-keypair-411595144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORW02yocZPfGtjS4x5m39xwUnhhpdRXATDIRbwoyVAL2P9TJBq7aR6tLY29JJlcrlmDBaAInYpnItmM0DfUDLOTN4/7yVIVF09YQBjrMJnVtAixSmdw0x+1d4LrHV4Fcg=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:34.277819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.278322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.278757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.279453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:34.279902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:34.280353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:34.291602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-d60be667-a487-49c0-9b9c-9249b7240140 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:34:34.295442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-d60be667-a487-49c0-9b9c-9249b7240140 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:34:34.318027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d60be667-a487-49c0-9b9c-9249b7240140 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047061 Oct 11 13:34:34.318666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 411/812] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:34:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:34.417304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:34.426009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cdc07847-42cb-489e-b944-c6ce9b566f0f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1691 microversion: 2.1 time: 0.162573 Oct 11 13:34:34.426585 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 402/813] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:34 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:35.135480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:35.136654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:35.146934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:35.147818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:35.148565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:35.149571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:35.150128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:35.150667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:35.357600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:35.366590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:35.368147 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:35.369391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d321b490-1ffc-4830-98d3-22971674184f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.240522 Oct 11 13:34:35.369977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 412/814] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:35 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:35.451157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:35.451842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:35.458545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:35.459023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:35.459455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:35.460172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:35.460652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:35.461312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:35.680259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:35.689191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cc77fd32-04a6-4abc-b939-b46dbdb6145f tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1691 microversion: 2.1 time: 0.241787 Oct 11 13:34:35.690068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 403/815] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:35 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:35.729235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1088042961", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9ecb25f-434f-42aa-a99d-d1d2a47d24ff"}], "security_groups": [{"name": "tempest-securitygroup--1625456164"}], "key_name": "tempest-keypair-411595144", "user_data": "}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:35.832922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] validate_networks() for [('f9ecb25f-434f-42aa-a99d-d1d2a47d24ff', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:34:36.220790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:34:36.221493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:34:36.221660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:34:36.222071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:34:36.222480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:34:36.231663 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.232205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.232643 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.233400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.233920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.234342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.251645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:34:36.256070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:34:36.271754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:34:36.274218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:34:36.323140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8e989339-5517-4e58-aa2e-beee9cbfd541 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598297 Oct 11 13:34:36.323779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 413/816] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:34:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:34:36.335268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f9a18647-46cc-4f3d-bc99-38fcda4472d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:36.335884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f9a18647-46cc-4f3d-bc99-38fcda4472d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:36.337888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:36.340509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=10 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:36.394973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:36.395136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f9a18647-46cc-4f3d-bc99-38fcda4472d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:36.395760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:36.402971 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.403789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f9a18647-46cc-4f3d-bc99-38fcda4472d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1241 microversion: 2.1 time: 0.072564 Oct 11 13:34:36.404075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.404419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.404762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 404/817] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:36 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:36.406530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.406988 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.407711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.412344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:36.712798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:36.713483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:36.721447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.722027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.722551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.723314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:36.723833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:36.724379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:36.836519 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:36.845347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:36.846928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:36.848139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0fbe8a56-e76a-4b73-ac5a-008bba339d2c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.457097 Oct 11 13:34:36.848781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 414/818] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:36 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:34:36.881191 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:36.889665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bdb73833-13c9-41d0-b01e-12d74e001002 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1691 microversion: 2.1 time: 0.180839 Oct 11 13:34:36.890228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 405/819] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:36 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:37.332240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "name": "network-vif-plugged", "status": "completed", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:37.342020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.342475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.343046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.354683 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] Creating event network-vif-plugged:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:34:37.359527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-23b10bd1-292b-412c-a68f-4f5842070895 req-58264dcd-67cd-4d94-98df-e469234c7ea4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089574 Oct 11 13:34:37.360368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 415/820] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:37.427127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:37.428072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:37.434255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.434812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.435414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.436206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.436674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.437102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.505217 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:37.513953 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ebbeda82-a156-4f87-90d3-ead2e5c0459e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1237 microversion: 2.1 time: 0.090796 Oct 11 13:34:37.514779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 406/821] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:37 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:37.879034 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:37.880108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:37.887946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.888512 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.888958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.889669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.890127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.890550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.913053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:37.913857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:37.920951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.921445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.921903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:37.922600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:37.923063 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:37.923482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:38.064916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:38.073495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:38.074934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:38.076041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3dd6d551-e995-40a9-a06d-ad895d4ca195 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.205127 Oct 11 13:34:38.076673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 416/822] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:37 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:38.091634 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:38.099602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-26ce3a2e-eaac-433c-85f2-6c06cc0791b3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1691 microversion: 2.1 time: 0.190420 Oct 11 13:34:38.100139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 407/823] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:37 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1691 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:38.541742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:38.542732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:38.553747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:38.554541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:38.555311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:38.555999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:38.556486 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:38.556912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:38.622667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:38.630645 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-07f2271f-3512-42d5-a885-8bc019a0451a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1293 microversion: 2.1 time: 0.095323 Oct 11 13:34:38.631238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 417/824] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:38 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:39.101866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:39.102437 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:39.109226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.109720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.110156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.110864 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.111324 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.111750 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.122650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:39.123733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:39.133094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.133783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.134418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.135533 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.135986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.136434 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.241570 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:39.250596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ec113e1f-19d4-4094-b597-7c17df47545a tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1623 microversion: 2.1 time: 0.131864 Oct 11 13:34:39.251853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 418/825] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:39 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1623 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:39.329218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:39.338153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:39.339666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:39.340864 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-137cac28-137e-4be6-9463-cd151475ec7c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1406 microversion: 2.20 time: 0.243260 Oct 11 13:34:39.341417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 408/826] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:39 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:34:39.654287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:39.654891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:39.661842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.662329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.662769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.663623 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.664250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.664944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.760288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:39.773251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d687261c-d21c-474f-84c5-c3979be9728b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1301 microversion: 2.1 time: 0.122758 Oct 11 13:34:39.788632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 419/827] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:39 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:39.835828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8920d883-8c41-45a3-bcd1-06959e5be7cb", "name": "network-vif-deleted", "tag": "0fc6ad1e-e518-4eac-8c6e-53882b164bb3"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:39.853757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:39.854484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:39.855932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:39.872365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] Creating event network-vif-deleted:0fc6ad1e-e518-4eac-8c6e-53882b164bb3 for instance 8920d883-8c41-45a3-bcd1-06959e5be7cb on hv-cinder-85061 Oct 11 13:34:39.879167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-a312ff21-e7ba-4dcb-851e-f54a5ec4dbe3 req-d427008e-a5b3-49e7-af6c-b2e5b06828e8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049150 Oct 11 13:34:39.880266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 409/828] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:40.284729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:40.285415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:40.291507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.292008 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.292620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.293459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.293983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.294625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.327328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.328315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.328814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.329357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'fault' on Instance uuid 8920d883-8c41-45a3-bcd1-06959e5be7cb {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:40.370009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:40.370815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:40.375993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:40.381179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.382264 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.382910 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.384510 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.384630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b6216e36-cf66-4f8b-be2b-a4acd79d72a5 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 200 len: 1336 microversion: 2.1 time: 0.104943 Oct 11 13:34:40.385252 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.391265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 420/829] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:40 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:34:40.392107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.551895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:40.561979 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:40.563365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:40.564584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6a28d6b1-d7c9-4762-bd7b-0cd5d29f958b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1599 microversion: 2.20 time: 0.201909 Oct 11 13:34:40.565149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 410/830] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:34:40 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:34:40.589504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:40.590002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:40.598234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.598741 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.599357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.600262 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.601172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.601817 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.714049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-39fd19f3-cb3f-4497-a4ea-3f10ee1e804f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.128562 Oct 11 13:34:40.715835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 421/831] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Oct 11 13:34:40 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:34:40.800502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:40.801137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:40.811622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.812152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.812612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:40.813366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:40.813829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:40.814262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:41.060211 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:41.078164 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-53e8d1e5-99b1-49f4-bf3c-68d068d7204e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.281374 Oct 11 13:34:41.095091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 411/832] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:40 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:41.412539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:41.413143 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 8920d883-8c41-45a3-bcd1-06959e5be7cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:41.419204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:41.419680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:41.420321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:41.421187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:41.421636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:41.422242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:41.436568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] HTTP exception thrown: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Request method failure captured: Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb HTTP/1.1 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW86WkXZFFRXybGXfjtMsJAfkQa63WbdzIDE7vOsnNzhefqC3u9dLr0PwBz_QNwLRJ_QvPtrrH9YzIgqaXzvCzS4Qag21J41-2hA5KXSNUYi2AJfMonufwXe4fkAxaG0kEWNhu_ykK-VDIHDelxlP2geuUDJ-7vJvVOp7hawt7TnZqM Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:41.438219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}] Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b50f86c6209f4a728cf3681a7d0a6765 Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. Oct 11 13:34:41.439926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '8920d883-8c41-45a3-bcd1-06959e5be7cb'} Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:41.440876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. Oct 11 13:34:41.442312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:41.443624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Returning 404 to user: Instance 8920d883-8c41-45a3-bcd1-06959e5be7cb could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:41.443624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-886fdbb5-0cef-4857-b0dc-e183ba14d6e0 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb" status: 404 len: 111 microversion: 2.1 time: 0.031480 Oct 11 13:34:41.450319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f8e3b962-51ba-4b7c-96f7-d83c7c162594 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '.version_select at 0x7f7a55070820>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:41.453150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 422/833] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:41 2022] GET /compute/v2.1/servers/8920d883-8c41-45a3-bcd1-06959e5be7cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:41.474233 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f8e3b962-51ba-4b7c-96f7-d83c7c162594 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636502401" status: 202 len: 0 microversion: 2.1 time: 0.027387 Oct 11 13:34:41.474828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 412/834] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 11 13:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636502401 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:34:41.903511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:41.910127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783f4b57-ab72-4c26-90f3-b8c27d3b69e5", "tag": "455fa857-8f7f-4ce9-b151-eb6b9603d9f7"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:41.914753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:41.915600 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:41.916308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:41.922163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:41.922649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:41.923088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:41.929970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] Creating event network-changed:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:34:41.937182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-0bc09f02-a25a-46e5-8703-bc3de1753a2b req-d370b085-2699-46ed-8195-11c4a355fff5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037514 Oct 11 13:34:41.938123 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 413/835] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:41.938244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] Creating event network-changed:455fa857-8f7f-4ce9-b151-eb6b9603d9f7 for instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 on hv-cinder-85061 Oct 11 13:34:41.943104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-ceb194da-d160-44c9-8581-e1b874d8c3e1 req-e9e39f6c-cbe0-4611-8195-2c8c0bcc8f61 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036843 Oct 11 13:34:41.943851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 423/836] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:42.103861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:42.104854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:42.111072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:42.111562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:42.112007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:42.112744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:42.113254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:42.113686 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:42.259297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:42.267595 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=100 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:42.270461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e2763b69-f98b-4b0c-bd39-fd1c5aca5ac0 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.171328 Oct 11 13:34:42.271187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 414/837] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:42 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:43.295983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:43.296662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:43.303378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:43.303853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:43.304317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:43.305051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:43.305501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:43.308110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:43.441779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:43.449733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2e73bfe5-d99d-415b-be32-74d7f03b5f8e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.158624 Oct 11 13:34:43.450307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 424/838] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:43 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:44.473441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:44.474050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:44.481005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.481494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.481935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.482636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.483089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.483515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.518260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:44.518804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:44.525873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.526427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.527088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.528012 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.528551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.529288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.554976 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:44.622303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:44.630737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-08e8a537-9294-45ce-b96f-6aa7d73863a1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.161075 Oct 11 13:34:44.631634 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 415/839] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:44 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:44.651006 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5eb0f99b-5507-4171-b025-866df881f050 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 204 len: 0 microversion: 2.1 time: 0.136046 Oct 11 13:34:44.652497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 425/840] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:34:44 2022] DELETE /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:44.660833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:44.661545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:44.667947 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.668533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.668969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.669668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:44.670113 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:44.670534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:44.801243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:44.809484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4aeb6af5-b5cd-4fd0-9865-8b9a1c9d04b2 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1509 microversion: 2.1 time: 0.152585 Oct 11 13:34:44.810062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 416/841] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:44 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:45.654722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:45.655417 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:45.662289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:45.662716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:45.663151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:45.663842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:45.664328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:45.664755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:45.802370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:45.820874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1fd43e43-ec75-4b8e-be1e-b7fafc2da6e8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.170501 Oct 11 13:34:45.826258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 426/842] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:45 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:45.837091 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:45.838315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:45.844815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:45.845521 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:45.846115 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:45.847539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:45.848168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:45.848744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:45.872877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbf33db-3a51-4c5a-af47-00e632d2cbb9", "name": "network-vif-deleted", "tag": "ff1917f6-b480-42fc-aa3c-be06bebf4ac3"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:45.888813 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:45.889294 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:45.889720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:45.902830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] Creating event network-vif-deleted:ff1917f6-b480-42fc-aa3c-be06bebf4ac3 for instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 on hv-cinder-85061 Oct 11 13:34:45.909266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-257dd7c1-c848-4ef8-bc5c-9ebd67f9a750 req-4241fe30-34e7-40c0-b340-bd6c10fb7482 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039921 Oct 11 13:34:45.910438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 427/843] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:45.920978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:45.929182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cf08cf73-b8fa-4cae-b038-adf2ca81dbac tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 200 len: 1467 microversion: 2.1 time: 0.100400 Oct 11 13:34:45.929971 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 417/844] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:45 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 1467 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:46.843580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:46.844379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=12 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:46.849117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:46.849827 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:46.857083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.857577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.858011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:46.858699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.859148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.859574 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:46.952934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:46.953607 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7dbf33db-3a51-4c5a-af47-00e632d2cbb9] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:46.955519 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:46.960989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.961469 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.961885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:46.962799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.963635 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.964084 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:46.979118 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] HTTP exception thrown: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Request method failure captured: Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 HTTP/1.1 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW86WkXZFFRXybGXfjtMsJAfkQa63WbdzIDE7vOsnNzhefqC3u9dLr0PwBz_QNwLRJ_QvPtrrH9YzIgqaXzvCzS4Qag21J41-2hA5KXSNUYi2AJfMonufwXe4fkAxaG0kEWNhu_ykK-VDIHDelxlP2geuUDJ-7vJvVOp7hawt7TnZqM Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:46.980807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}] Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b50f86c6209f4a728cf3681a7d0a6765 Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. Oct 11 13:34:46.982236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '7dbf33db-3a51-4c5a-af47-00e632d2cbb9'} Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:46.983236 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. Oct 11 13:34:46.985060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:46.987582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Returning 404 to user: Instance 7dbf33db-3a51-4c5a-af47-00e632d2cbb9 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:46.987582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0c3cda3e-291a-4bd6-a251-dd5fb7b9f89e tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9" status: 404 len: 111 microversion: 2.1 time: 0.033239 Oct 11 13:34:46.987582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 418/845] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:46 2022] GET /compute/v2.1/servers/7dbf33db-3a51-4c5a-af47-00e632d2cbb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:34:46.990563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:46.991051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:46.996042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:46.997344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.997827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.998255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:46.998993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:46.999453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:46.999886 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:47.004140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d6a6b54a-110c-433d-8993-950d8a75030b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.161462 Oct 11 13:34:47.008599 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 428/846] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:46 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:47.026117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:34:47.111177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-febe3c89-2231-4ea3-9777-21cd8f347228 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 204 len: 0 microversion: 2.1 time: 0.123919 Oct 11 13:34:47.112034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 419/847] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:34:46 2022] DELETE /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:34:47.120244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:47.120849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:47.126770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:47.127245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:47.127671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:47.128376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:47.128821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:47.129235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:47.264422 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:47.272384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e716cf3c-99e4-43d2-9882-2b8e272fc3c3 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.156061 Oct 11 13:34:47.273028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 429/848] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:47 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:47.345545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783f4b57-ab72-4c26-90f3-b8c27d3b69e5", "name": "network-vif-plugged", "status": "completed", "tag": "455fa857-8f7f-4ce9-b151-eb6b9603d9f7"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:47.355242 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:47.355719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:47.356180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:47.367331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] Creating event network-vif-plugged:455fa857-8f7f-4ce9-b151-eb6b9603d9f7 for instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 on hv-cinder-85061 Oct 11 13:34:47.372097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-e9a6cb68-fa16-4eda-9b35-8987a593200d req-762845ef-3397-4235-a7f1-053c7c4da45d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Oct 11 13:34:47.372939 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 420/849] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:48.027138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:48.027770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:48.034725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:48.035198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:48.035627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:48.036366 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:48.036815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:48.037235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:48.169095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:48.177327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-51e0897d-f4ad-4227-ab85-73600ca46a64 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1367 microversion: 2.1 time: 0.154065 Oct 11 13:34:48.177879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 430/850] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:48 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:48.296674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:48.297516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:48.303874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:48.304401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:48.304834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:48.305527 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:48.305975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:48.306402 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:48.443261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:48.452052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-46619554-e3ce-4553-90da-d201e4206dc7 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1521 microversion: 2.1 time: 0.160235 Oct 11 13:34:48.452681 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 421/851] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:48 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:48.765251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d119505-75d4-4f57-8292-83839956f749", "name": "network-vif-deleted", "tag": "f1a0db70-a61c-43e6-8700-e593abe74b8d"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:48.770541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:48.775943 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:48.776470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:48.776900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:48.790564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] Creating event network-vif-deleted:f1a0db70-a61c-43e6-8700-e593abe74b8d for instance 7d119505-75d4-4f57-8292-83839956f749 on hv-cinder-85061 Oct 11 13:34:48.797395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-67e98d39-b66e-42bf-8a5f-8579c627530a req-a5c1fe7f-24b3-4120-9b11-32d95d231261 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035735 Oct 11 13:34:48.798056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 431/852] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:49.200048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:49.200779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:49.207042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.207597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.208093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.208885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.209403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.209887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.341042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:49.348760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a9f624fd-f75c-4c96-aeaf-943bd3bd9900 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1556 microversion: 2.1 time: 0.152822 Oct 11 13:34:49.349346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 422/853] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:49 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:49.375352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:49.375928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:49.382555 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.383043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.383480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.384204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.384677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.385103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.402179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:34:49.465189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fd2361dc-712c-4f43-b8db-2dffe9ee2023 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095540 Oct 11 13:34:49.465797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 432/854] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:34:49 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:49.475185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:49.475798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:49.482682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.483188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.483649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.484395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.484861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.485291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.517226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:49.518013 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:49.518445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:49.518887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lazy-loading 'fault' on Instance uuid 7d119505-75d4-4f57-8292-83839956f749 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:34:49.559879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50f86c6209f4a728cf3681a7d0a6765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f14bd1e0fd419383ac2bf2ab87e6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:34:49.567579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c67d61dd-692f-49f4-a2e0-4e5b9a691309 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 200 len: 1311 microversion: 2.1 time: 0.096442 Oct 11 13:34:49.575670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 423/855] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:49 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:34:50.591534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:50.592007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] [instance: 7d119505-75d4-4f57-8292-83839956f749] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:34:50.598963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:50.599452 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:50.599887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:50.600587 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:50.601043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:50.601468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:50.615279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] HTTP exception thrown: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Request method failure captured: Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 HTTP/1.1 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW86WkXZFFRXybGXfjtMsJAfkQa63WbdzIDE7vOsnNzhefqC3u9dLr0PwBz_QNwLRJ_QvPtrrH9YzIgqaXzvCzS4Qag21J41-2hA5KXSNUYi2AJfMonufwXe4fkAxaG0kEWNhu_ykK-VDIHDelxlP2geuUDJ-7vJvVOp7hawt7TnZqM Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:50.617462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/46f14bd1e0fd419383ac2bf2ab87e6d0"}]}] Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 46f14bd1e0fd419383ac2bf2ab87e6d0 Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-641588676 Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b50f86c6209f4a728cf3681a7d0a6765 Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-ServerRescueNegativeTestJSON-641588676-project Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. Oct 11 13:34:50.619037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '7d119505-75d4-4f57-8292-83839956f749'} Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:50.619869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. Oct 11 13:34:50.621536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:50.623149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] Returning 404 to user: Instance 7d119505-75d4-4f57-8292-83839956f749 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:50.623149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fa38d322-af34-408a-8172-743b87728e05 tempest-ServerRescueNegativeTestJSON-641588676 tempest-ServerRescueNegativeTestJSON-641588676-project] 10.222.0.15 "GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749" status: 404 len: 111 microversion: 2.1 time: 0.031356 Oct 11 13:34:50.623149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 433/856] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:34:50 2022] GET /compute/v2.1/servers/7d119505-75d4-4f57-8292-83839956f749 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:50.818630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "783f4b57-ab72-4c26-90f3-b8c27d3b69e5", "tag": "455fa857-8f7f-4ce9-b151-eb6b9603d9f7"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:50.829855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:34:50.830440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:34:50.830973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:34:50.843454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] Creating event network-changed:455fa857-8f7f-4ce9-b151-eb6b9603d9f7 for instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 on hv-cinder-85061 Oct 11 13:34:50.849505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-3d162be8-dc4b-4cac-a9f6-556fc6b61c4c req-26311284-867e-47e3-9165-53d42148fe0d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036102 Oct 11 13:34:50.850426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 424/857] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:34:55.382391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-40c76701-b2d4-45ba-9ac9-3c0ccbaab8d8 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Action: 'create', calling method: .version_select at 0x7f7a54e89040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547786566", "metadata": {"Type": "work"}}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-40c76701-b2d4-45ba-9ac9-3c0ccbaab8d8 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 121 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:55.398106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547786566", "metadata": {"Type": "work"}}} Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:34:55.399581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-547786566', 'metadata': {'Type': 'work'}}}} Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.400445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:34:55.403554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:34:55.404744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 13:34:55.404744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.404744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-40c76701-b2d4-45ba-9ac9-3c0ccbaab8d8 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.404744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-40c76701-b2d4-45ba-9ac9-3c0ccbaab8d8 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149419 Oct 11 13:34:55.404744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 434/858] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 11 13:34:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:34:55.410979 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-420b9aa8-7f16-42e5-9be7-be553f2acd6a tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Action: 'create', calling method: .version_select at 0x7f7a55123160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-526273387", "metadata": {"Type": "work"}}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-420b9aa8-7f16-42e5-9be7-be553f2acd6a tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 119 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:55.415627 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-526273387", "metadata": {"Type": "work"}}} Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: Oct 11 13:34:55.417258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-526273387', 'metadata': {'Type': 'work'}}}} Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi '0' Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.422235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:34:55.423802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:34:55.425171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 13:34:55.425171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.425171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-420b9aa8-7f16-42e5-9be7-be553f2acd6a tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.425171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-420b9aa8-7f16-42e5-9be7-be553f2acd6a tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010971 Oct 11 13:34:55.425171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 425/859] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 11 13:34:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:34:55.426532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9700002e-8d20-42c4-bf12-e6db0646de8d tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Action: 'create', calling method: .version_select at 0x7f7a54f7fe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-29586721", "metadata": {"Type": "work"}}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9700002e-8d20-42c4-bf12-e6db0646de8d tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 117 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:55.431136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-29586721", "metadata": {"Type": "work"}}} Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:34:55.432724 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-29586721', 'metadata': {'Type': 'work'}}}} Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise error Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi '' Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.433765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 13:34:55.435353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 13:34:55.437149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 13:34:55.437149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.437149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9700002e-8d20-42c4-bf12-e6db0646de8d tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.437149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9700002e-8d20-42c4-bf12-e6db0646de8d tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009702 Oct 11 13:34:55.437149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 435/860] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 11 13:34:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:34:55.441456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-857936ec-5ae1-43b3-9b84-f6544ed89754 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Calling method '.version_select at 0x7f7a54ed0f70>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:55.470369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-857936ec-5ae1-43b3-9b84-f6544ed89754 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] HTTP exception thrown: Volume tempest-invalid-1563795982 could not be found. Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-857936ec-5ae1-43b3-9b84-f6544ed89754 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1563795982 HTTP/1.1 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:55.473680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Volume tempest-invalid-1563795982 could not be found. Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'tempest-invalid-1563795982'} Oct 11 13:34:55.475238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1563795982 could not be found. (HTTP 404) (Request-ID: req-a720d592-3e26-41d2-9804-6c7d633c48d0) Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.476139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:34:55.477515 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1563795982 could not be found. Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:55.478919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1563795982 could not be found. Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1563795982 could not be found. Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-857936ec-5ae1-43b3-9b84-f6544ed89754 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 404 to user: Volume tempest-invalid-1563795982 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-857936ec-5ae1-43b3-9b84-f6544ed89754 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1563795982" status: 404 len: 99 microversion: 2.1 time: 0.037342 Oct 11 13:34:55.480539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 426/861] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 11 13:34:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1563795982 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 13:34:55.485413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d877cb57-c5d9-4bff-bd38-07075ab59692 tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003740 Oct 11 13:34:55.485896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 436/862] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Oct 11 13:34:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 13:34:55.493891 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9ccd8c79-fe5a-4323-8e0b-2839de0d705d tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003625 Oct 11 13:34:55.494369 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 427/863] 10.222.0.15 () {58 vars in 1137 bytes} [Tue Oct 11 13:34:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 13:34:55.502216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f1fbe4e9-bdfc-471f-b62c-c070c56470cd tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Calling method '.version_select at 0x7f7a551053a0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:55.531076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-f1fbe4e9-bdfc-471f-b62c-c070c56470cd tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] HTTP exception thrown: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f1fbe4e9-bdfc-471f-b62c-c070c56470cd tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: DELETE /compute/v2.1/os-volumes/6a7626e5-f778-4ab3-86d8-190071c813f7 HTTP/1.1 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:34:55.534348 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '6a7626e5-f778-4ab3-86d8-190071c813f7'} Oct 11 13:34:55.535914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. (HTTP 404) (Request-ID: req-b05f5e7f-88ce-4f86-84ff-9af82580f2ca) Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.536895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:34:55.538047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 13:34:55.539129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f1fbe4e9-bdfc-471f-b62c-c070c56470cd tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 404 to user: Volume 6a7626e5-f778-4ab3-86d8-190071c813f7 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f1fbe4e9-bdfc-471f-b62c-c070c56470cd tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/6a7626e5-f778-4ab3-86d8-190071c813f7" status: 404 len: 109 microversion: 2.1 time: 0.036956 Oct 11 13:34:55.540242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 437/864] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:34:55 2022] DELETE /compute/v2.1/os-volumes/6a7626e5-f778-4ab3-86d8-190071c813f7 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:34:55.545760 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-990519ef-841c-40e0-b6f1-c304902294aa tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Calling method '.version_select at 0x7f7a54ed0700>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:34:55.574653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-990519ef-841c-40e0-b6f1-c304902294aa tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] HTTP exception thrown: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-990519ef-841c-40e0-b6f1-c304902294aa tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Request method failure captured: Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/os-volumes/0e084511-3d7c-4234-ac14-9ccbfddba658 HTTP/1.1 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXD_1N1wS-11FtcgD8bceOichiy80xG_871u61qWUB_ox9-N8vQW63_nw3fhVqYnC3bV-lKwBbb0arE70EWmA-7U80XapTDuRgjDjoWpsxD6HyIcdJdyH_KBA-diNXdLF8qyBq951-E76JTfgcXcND0axq7p9QAXndQ1_mHAf_ZwyHE Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:34:55.576632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f409887455bd4eeb81677346f21555d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f409887455bd4eeb81677346f21555d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f409887455bd4eeb81677346f21555d9"}]}] Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: f409887455bd4eeb81677346f21555d9 Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesNegativeTest-90851911 Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b5c95e0595f7451f8f84c3f51b040447 Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesNegativeTest-90851911-project Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '0e084511-3d7c-4234-ac14-9ccbfddba658'} Oct 11 13:34:55.578105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. (HTTP 404) (Request-ID: req-2f4ef7ec-132f-44e4-8b94-56fbfafd4a9f) Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.578974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:34:55.580110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 13:34:55.581296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-990519ef-841c-40e0-b6f1-c304902294aa tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] Returning 404 to user: Volume 0e084511-3d7c-4234-ac14-9ccbfddba658 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-990519ef-841c-40e0-b6f1-c304902294aa tempest-VolumesNegativeTest-90851911 tempest-VolumesNegativeTest-90851911-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/0e084511-3d7c-4234-ac14-9ccbfddba658" status: 404 len: 109 microversion: 2.1 time: 0.036241 Oct 11 13:34:55.582435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 428/865] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:34:55 2022] GET /compute/v2.1/os-volumes/0e084511-3d7c-4234-ac14-9ccbfddba658 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:24.900298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=5 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:24.901052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:24.905231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:24.908078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:24.914873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:24.915351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:24.915792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:24.916511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:24.916967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:24.917379 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:24.945815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c87ca758-968e-454e-b5f0-77611186061a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047137 Oct 11 13:35:24.946363 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 438/866] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:24 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:35:25.013776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:25.015517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:25.020409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:25.021319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:25.029861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:25.030473 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:25.030911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:25.031592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:25.032058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:25.032503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:25.060452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:35:25.140807 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e2992b1e-5356-4be0-9cea-7ea58168cdd7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 204 len: 0 microversion: 2.1 time: 0.131061 Oct 11 13:35:25.141295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 429/867] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:35:25 2022] DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:35:25.151111 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:25.151723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:25.158174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:25.158648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:25.159082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:25.159763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:25.160248 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:25.160667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:25.298735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:25.307021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b996b307-3e9c-4783-9190-c713d15ed3c0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1674 microversion: 2.1 time: 0.161010 Oct 11 13:35:25.307590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 439/868] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:25 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:26.336285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:26.337396 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:26.344561 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:26.345040 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:26.345473 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:26.346164 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:26.346613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:26.347039 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:26.479511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:26.487390 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e1912f21-1e91-466c-8bf0-2eb8a79f5861 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1674 microversion: 2.1 time: 0.158446 Oct 11 13:35:26.495815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 430/869] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:26 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:27.510895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:27.511494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:27.518357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:27.518840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:27.519271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:27.519958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:27.520436 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:27.520857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:27.582955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:27.591945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-651cd026-38a3-4c46-bc91-b5759e7b4292 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 200 len: 1606 microversion: 2.1 time: 0.084956 Oct 11 13:35:27.601930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 440/870] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:27 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:27.630472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a", "name": "network-vif-deleted", "tag": "40098450-36a3-4009-9731-eb6463cc6f92"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:27.642869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:27.643348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:27.643775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:27.656488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] Creating event network-vif-deleted:40098450-36a3-4009-9731-eb6463cc6f92 for instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a on hv-cinder-85061 Oct 11 13:35:27.663837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-c5ac6e4f-5eb7-4d2e-9b7f-cdd7ce1a46d9 req-b362698b-b27e-4792-8d47-e87267fa99a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Oct 11 13:35:27.664474 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 431/871] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:28.616166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:28.616890 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:28.624077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:28.624692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:28.625203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:28.625920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:28.626378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:28.626806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:28.641203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a HTTP/1.1 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:35:28.642900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:35:28.644669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a'} Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:35:28.645524 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:35:28.646861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:35:28.649238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:35:28.649238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2bfbb7c4-54ff-4c50-ae2a-57d7c1ba9ecd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 404 len: 111 microversion: 2.1 time: 0.032045 Oct 11 13:35:28.649238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 441/872] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:28 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:28.655137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-29466ecf-95d4-4561-921f-49208d82a99e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '.version_select at 0x7f7a55109790>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:28.674010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-29466ecf-95d4-4561-921f-49208d82a99e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20210850" status: 202 len: 0 microversion: 2.1 time: 0.023651 Oct 11 13:35:28.674549 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 432/873] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Oct 11 13:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20210850 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:35:29.308536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e5385799-d292-45aa-9c00-c5cd0781e272 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: .version_select at 0x7f7a54e898b0>, body: {"keypair": {"name": "tempest-keypair-883790448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8x3OOimSq0/plrbO1ylr7Hmqv+A7IZ+rlyrwHc/Ap7q3SoIDuZ1aBBE88OsHfM/GdEsepi3gd7NU5VvjxzHeLL+YwiJyLXs8sa53QMt7d1OKiq9lb3M9jgdv4tJT/hGA=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:29.324421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-e5385799-d292-45aa-9c00-c5cd0781e272 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:35:29.328376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-e5385799-d292-45aa-9c00-c5cd0781e272 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for user 9a4a84c1ffc4466687122a6c67536d9b and project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:35:29.352020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e5385799-d292-45aa-9c00-c5cd0781e272 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047489 Oct 11 13:35:29.352853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 442/874] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:35:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:30.665382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2062135364", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13ee43d0-bd80-49dd-bae0-79ed5fdf057b"}], "security_groups": [{"name": "tempest-securitygroup--881538554"}], "key_name": "tempest-keypair-883790448", "user_data": "}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:30.785884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] validate_networks() for [('13ee43d0-bd80-49dd-bae0-79ed5fdf057b', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:35:31.389537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:35:31.389968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:35:31.390440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:35:31.390840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:35:31.391245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:35:31.400660 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:31.401133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:31.401567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:31.402279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:31.402730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:31.403148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:31.421541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:35:31.425508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Getting quotas for user 9a4a84c1ffc4466687122a6c67536d9b and project 33ec6c4b270341c5a4ebce407bb5cca9. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:35:31.436300 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:35:31.438714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:35:31.492731 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6676d419-4b83-46ae-a035-9bbb2ac92caf tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.832137 Oct 11 13:35:31.494012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 433/875] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:35:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:35:31.504833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-652a6793-b684-47f5-9805-f934bd28c4d0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:31.505410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-652a6793-b684-47f5-9805-f934bd28c4d0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:31.563246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-652a6793-b684-47f5-9805-f934bd28c4d0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:31.570926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-652a6793-b684-47f5-9805-f934bd28c4d0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1237 microversion: 2.1 time: 0.069793 Oct 11 13:35:31.571503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 443/876] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:31 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:32.594077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:32.595215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:32.602409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:32.602928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:32.603435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:32.604143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:32.604580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:32.605294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:32.677239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:32.685736 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-40b5bcec-6824-4640-8c4a-3702c3b826c4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1297 microversion: 2.1 time: 0.095994 Oct 11 13:35:32.686314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 434/877] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:32 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:33.710622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:33.711278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:33.718139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:33.718627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:33.719045 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:33.719769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:33.720240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:33.720667 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:33.867628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:33.875344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f36d108f-cc93-425f-9d09-ceed902a1652 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.169466 Oct 11 13:35:33.875908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 444/878] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:33 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:34.903135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:34.904004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:34.914906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:34.915701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:34.916527 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:34.917582 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:34.918040 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:34.918466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:35.048509 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:35.056308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c49b3eea-ce03-45bb-b505-0f5b39b69e77 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.159881 Oct 11 13:35:35.056847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 435/879] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:34 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:35.927412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d176db-faf6-433a-87b8-c43e7f9004e5", "tag": "c7ede12d-65a1-43ab-a710-3d364fde6312"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:35.938019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:35.938499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:35.938922 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:35.950000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] Creating event network-changed:c7ede12d-65a1-43ab-a710-3d364fde6312 for instance 69d176db-faf6-433a-87b8-c43e7f9004e5 on hv-cinder-85061 Oct 11 13:35:35.955068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-16598275-7dc8-45dd-afbc-7a35adce4771 req-090c90dd-958b-4ed1-bb17-41db37539abe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031512 Oct 11 13:35:35.955652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 445/880] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:35:36.089331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:36.089950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:36.097857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:36.098401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:36.098888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:36.099649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:36.100152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:36.100671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:36.238954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:36.246779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7b408a44-0303-41fc-936e-26184039a7f5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.164093 Oct 11 13:35:36.247347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 436/881] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:36 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:37.271046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:37.271736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:37.278357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:37.278820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:37.279286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:37.279975 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:37.280468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:37.280887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:37.414192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:37.421944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c069a228-5186-42ff-8462-9219f620cf3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.155695 Oct 11 13:35:37.422510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 446/882] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:37 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:38.445166 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:38.445740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:38.452829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:38.453329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:38.453761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:38.454455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:38.454897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:38.455319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:38.589687 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:38.597499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8ac23377-b7c5-42dc-8bec-8c777d2acd72 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.156413 Oct 11 13:35:38.598097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 437/883] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:38 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:39.620856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:39.621477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:39.628608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:39.629098 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:39.629530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:39.630344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:39.630807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:39.631234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:39.774136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:39.782164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0abf1be3-aba7-4939-963e-f481421b42dd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.165402 Oct 11 13:35:39.782729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 447/884] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:39 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:40.807950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:40.808570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:40.818660 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:40.819172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:40.819745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:40.820726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:40.821385 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:40.821999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:40.960260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:40.968484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d3990318-1247-485b-97aa-f657d534d792 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.165603 Oct 11 13:35:40.969065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 438/885] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:40 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:41.995277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:41.996255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:42.000218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:42.008225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:42.008714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:42.009153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:42.009852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:42.010310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:42.010738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:42.142412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:42.150495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1674fa5b-54c0-48b1-ab9e-40f74dfaa88a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.162040 Oct 11 13:35:42.151077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 448/886] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:41 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:43.173689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:43.174304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:43.176343 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:43.176915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=6 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:43.183391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:43.183903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:43.184435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:43.185093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:43.185625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:43.186055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:43.319526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:43.327745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-355733e2-1498-4752-b28b-e2d85a13a863 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.157852 Oct 11 13:35:43.328375 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 439/887] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:43 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:43.553114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d176db-faf6-433a-87b8-c43e7f9004e5", "name": "network-vif-plugged", "status": "completed", "tag": "c7ede12d-65a1-43ab-a710-3d364fde6312"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:43.564204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:43.564797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:43.566002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:43.580215 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] Creating event network-vif-plugged:c7ede12d-65a1-43ab-a710-3d364fde6312 for instance 69d176db-faf6-433a-87b8-c43e7f9004e5 on hv-cinder-85061 Oct 11 13:35:43.586977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-1dc38451-5e35-4344-9c94-b413347b4328 req-2e877674-7c97-4be7-bdd8-70f49e4a62a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037438 Oct 11 13:35:43.588049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 449/888] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:44.351153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:44.351837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:44.358536 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:44.359037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:44.359465 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:44.360167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:44.360630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:44.361051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:44.494978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:44.502844 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-11693ceb-91ae-408f-a7da-cd331b0efd90 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.155703 Oct 11 13:35:44.503413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 440/889] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:44 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:45.526824 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:45.527494 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:45.534122 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:45.534602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:45.535036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:45.535723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:45.536205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:45.536627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:45.782664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:45.791729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d59be9fb-8784-4b88-a1c7-6701ca4444d8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1362 microversion: 2.1 time: 0.268937 Oct 11 13:35:45.792316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 450/890] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:45 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:46.819377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:46.820280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:46.826619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:46.830592 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:46.831138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:46.832151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:46.832714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:46.833239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:47.119036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1743799828"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:47.119592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:47.127473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:47.127974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:47.128440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:47.129148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:47.129604 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:47.130061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:47.134814 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:47.149159 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-48e4ea94-f54c-4409-970e-dfc684fb61d5 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1548 microversion: 2.1 time: 0.333963 Oct 11 13:35:47.150095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 441/891] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:46 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1548 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:47.173060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:47.173701 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:47.180475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:47.181200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:47.181935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:47.183108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:47.183633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:47.184156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:47.317869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7a617143-7e36-495b-bf99-520343d9a8e4 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148754 Oct 11 13:35:47.319006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 442/892] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:35:47 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:47.413789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.network.security_group_api [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Removing security group 49faddb5-a5ac-4208-a16b-96d30ed7fdef from port 46db3884-5f07-4b1a-ba2e-5421ca606433 Oct 11 13:35:48.211508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1c06b6ff-c38b-4e2b-bcb8-0b38f18daa89 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action" status: 202 len: 0 microversion: 2.1 time: 1.096454 Oct 11 13:35:48.213571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 451/893] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:35:47 2022] POST /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:35:48.227589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:48.240246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:48.240732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:48.241171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:48.270472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] Creating event network-changed:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:35:48.276711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-89480424-7ab5-447e-a56f-21b33ec87e4a req-a2893178-01fa-4fa8-a9b4-e90ab6821477 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052579 Oct 11 13:35:48.277893 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 443/894] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:48.503261 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d176db-faf6-433a-87b8-c43e7f9004e5", "tag": "c7ede12d-65a1-43ab-a710-3d364fde6312"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:48.518723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:48.519207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:48.519637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:48.554715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] Creating event network-changed:c7ede12d-65a1-43ab-a710-3d364fde6312 for instance 69d176db-faf6-433a-87b8-c43e7f9004e5 on hv-cinder-85061 Oct 11 13:35:48.560605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-f18e7469-3f70-4a62-afdc-b9f0977fe7e4 req-67ec830b-7331-437e-ac01-3ff26ac5b188 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060908 Oct 11 13:35:48.561291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 452/895] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:49.630409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:49.631137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:49.646265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:49.647038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:49.647641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:49.648455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:49.648984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:49.649482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:49.755634 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lazy-loading 'services' on Instance uuid 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:35:49.856934 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-83691636-e707-4dc3-9011-dbc61230b326 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments/a6d0e792-363f-40b3-aaf7-93fcd838ddc7" status: 202 len: 0 microversion: 2.1 time: 0.233258 Oct 11 13:35:49.858249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 444/896] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:35:49 2022] DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments/a6d0e792-363f-40b3-aaf7-93fcd838ddc7 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:35:49.869849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:49.873256 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:49.888278 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:49.889122 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:49.889870 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:49.890853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:49.896660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:49.897596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:49.963227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-88964649-3a92-4461-9afd-4947932700f5 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099609 Oct 11 13:35:49.969090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 453/897] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:49 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:50.295361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:50.309504 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:50.310243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:50.310876 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:50.325816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] Creating event network-changed:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:35:50.331277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-18ddb0c8-5d9b-49c7-becb-ebf3e639700e req-4b7ca98c-e9a9-4544-b021-b332b74f95a2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040404 Oct 11 13:35:50.337452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 445/898] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:50.976439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:50.978601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:50.989901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:50.990384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:50.990814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:50.991576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:50.992021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:50.992465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:51.028750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5c371436-ff82-43cf-9af0-7c347e8396ee tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056208 Oct 11 13:35:51.033886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 454/899] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:50 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:52.042733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:52.045037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:52.051422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:52.051917 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:52.052391 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:52.053099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:52.053554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:52.054169 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:52.085803 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6f33574f-785c-4db7-add6-a49ff45a6723 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048532 Oct 11 13:35:52.086403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 446/900] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:52 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:53.099531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:53.109872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:53.121180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:53.122397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:53.124746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:53.125796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:53.126717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:53.127361 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:53.163798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-49639227-6be2-4952-a636-1ea1ba4055eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068765 Oct 11 13:35:53.169806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 455/901] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:53 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:54.605016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:54.609850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:54.618082 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:54.618888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:54.620260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:54.621251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:54.622567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:54.623326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:54.628930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:54.680817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-86c4f010-56da-468c-bbf1-922947794950 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.507125 Oct 11 13:35:54.682110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 447/902] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:54 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:55.693691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:55.695862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:55.698595 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:55.713711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:55.714195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:55.714614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:55.715502 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:55.716105 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:55.716547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:55.725960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=79 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:55.776207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8a65d56d-ea2c-4041-bde2-b2a13aba6a15 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086246 Oct 11 13:35:55.777580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 456/903] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:55 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:56.384094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a5fbbbcf-8385-451c-b21f-be6436c840f4 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Action: 'create', calling method: .version_select at 0x7f7a54fa21f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-169379414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxKavrLHyisAooZzbLItUA7ZeRIQbabOt9HoYhD09jb2Wiga4b2r0Vr35ftedgdMEFtiro8+yECrQdgttj8N8+UyXW/NfJvXWZ5LF4PYSshcjhk9nN5OFp6tHsh4T3PXw=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:35:56.389903 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:35:56.405865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-a5fbbbcf-8385-451c-b21f-be6436c840f4 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Getting quotas for project 81282f5bd6b34d90afaba281d5bbc16b. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:35:56.410879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-a5fbbbcf-8385-451c-b21f-be6436c840f4 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Getting quotas for user 983c742ffffe4a82a722eb1b1c23f971 and project 81282f5bd6b34d90afaba281d5bbc16b. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:35:56.437235 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a5fbbbcf-8385-451c-b21f-be6436c840f4 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.188330 Oct 11 13:35:56.437823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 448/904] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:35:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:35:56.789783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:56.813154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:56.820383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:56.820869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:56.821459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:56.822166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:56.822713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:56.823036 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:56.859014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c79a1e37-a98b-4277-8693-7371d6c35584 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073691 Oct 11 13:35:56.859908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 457/905] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:35:56 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:35:56.871694 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:56.872223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:56.880480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:56.881244 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:56.881913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:56.882790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:56.883441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:56.884048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:56.976055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] HTTP exception thrown: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb is not attached to volume a6d0e792-363f-40b3-aaf7-93fcd838ddc7 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Request method failure captured: Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments/a6d0e792-363f-40b3-aaf7-93fcd838ddc7 HTTP/1.1 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXAGaukZTSUNNof77aXo_9o0bRIIFioBtLxVAJdwbvM0pP3we5xgZpqUGHfYV6MFhtrV0W7pXnfuOCEhMQS9-rwT5HnhbkbdR8T2ppmEAOpjt2dVYkW2CT4sSqxL7ca8L3D73SxEpdeio7mt-xtSrvo19oBiZeqKBKdNeVjx3EkqiAw Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 07b1cc93b68340b787ee0c99f1bf7c68 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:35:56.978645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/07b1cc93b68340b787ee0c99f1bf7c68"}]}] Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 07b1cc93b68340b787ee0c99f1bf7c68 Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-TestMinimumBasicScenario-198290135-project Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: ee084e4a27a94d409653f36e786af9e7 Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-TestMinimumBasicScenario-198290135-project Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:35:56.980538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb is not attached to volume a6d0e792-363f-40b3-aaf7-93fcd838ddc7 Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'server_id': '38fb63c7-06cb-42a7-8f59-f6ec2b697eeb', 'id': 'a6d0e792-363f-40b3-aaf7-93fcd838ddc7'} Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a6d0e792-363f-40b3-aaf7-93fcd838ddc7. Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:35:56.981502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb is not attached to volume a6d0e792-363f-40b3-aaf7-93fcd838ddc7 Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb is not attached to volume a6d0e792-363f-40b3-aaf7-93fcd838ddc7 Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:35:56.982982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Returning 404 to user: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb is not attached to volume a6d0e792-363f-40b3-aaf7-93fcd838ddc7 {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:35:56.984104 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-04ed511d-3ffd-4e57-af3b-6c67190ed8aa tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments/a6d0e792-363f-40b3-aaf7-93fcd838ddc7" status: 404 len: 154 microversion: 2.1 time: 0.113937 Oct 11 13:35:56.984485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 449/906] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:35:56 2022] DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb/os-volume_attachments/a6d0e792-363f-40b3-aaf7-93fcd838ddc7 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:35:58.151919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:58.152428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:58.159112 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:58.159590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:58.160021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:58.160771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:58.161218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:58.161632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:58.187546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:35:58.434308 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fc9afdc7-eed4-491f-b302-8878214d9491 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 204 len: 0 microversion: 2.1 time: 0.285746 Oct 11 13:35:58.435282 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 458/907] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:35:58 2022] DELETE /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:35:58.443842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:58.445610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:58.452500 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:58.452986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:58.453420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:58.454125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:58.454579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:58.455007 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:58.592358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:58.601446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1f83e66b-7bc3-4837-a7a5-ad23b6ed1ff0 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1554 microversion: 2.1 time: 0.161161 Oct 11 13:35:58.602086 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 450/908] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:58 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:35:59.629258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:35:59.630089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:35:59.637401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:59.637958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:59.638397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:59.639088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:35:59.639538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:35:59.639959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:35:59.784495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:35:59.793316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cd1c293d-088c-44e3-9bf2-31abac734e6b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1554 microversion: 2.1 time: 0.168343 Oct 11 13:35:59.793904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 459/909] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:35:59 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:00.816129 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:00.816725 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:00.823873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:00.824422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:00.824819 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:00.825741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:00.826202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:00.826604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:00.957724 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:00.969780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-25b9201d-56f0-4f4b-840e-9b83e0f4a02b tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1554 microversion: 2.1 time: 0.157545 Oct 11 13:36:00.970382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 451/910] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:00 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:01.448432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38fb63c7-06cb-42a7-8f59-f6ec2b697eeb", "name": "network-vif-deleted", "tag": "46db3884-5f07-4b1a-ba2e-5421ca606433"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:01.460344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:01.460812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:01.461245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:01.472590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] Creating event network-vif-deleted:46db3884-5f07-4b1a-ba2e-5421ca606433 for instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb on hv-cinder-85061 Oct 11 13:36:01.477798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-cb272137-c925-435d-8d57-b91928d98761 req-f15c04f0-c63c-4619-abe0-f82d572d84e0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033321 Oct 11 13:36:01.478382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 460/911] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:01.994476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:01.995098 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:02.001776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:02.002492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:02.002937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:02.003644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:02.004068 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:02.004809 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:02.039095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:02.039866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:02.040381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:02.040840 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lazy-loading 'fault' on Instance uuid 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:36:02.081829 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee084e4a27a94d409653f36e786af9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b1cc93b68340b787ee0c99f1bf7c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:02.089552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3db524d9-dfe3-452b-925f-84ee0ebec4eb tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 200 len: 1348 microversion: 2.1 time: 0.099309 Oct 11 13:36:02.090081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 452/912] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:01 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:03.116975 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:03.117807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] [instance: 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:03.124246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:03.124999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:03.125529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:03.126283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:03.126799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:03.127224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:03.141903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] HTTP exception thrown: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Request method failure captured: Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb HTTP/1.1 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXAGaukZTSUNNof77aXo_9o0bRIIFioBtLxVAJdwbvM0pP3we5xgZpqUGHfYV6MFhtrV0W7pXnfuOCEhMQS9-rwT5HnhbkbdR8T2ppmEAOpjt2dVYkW2CT4sSqxL7ca8L3D73SxEpdeio7mt-xtSrvo19oBiZeqKBKdNeVjx3EkqiAw Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 07b1cc93b68340b787ee0c99f1bf7c68 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:36:03.143938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/07b1cc93b68340b787ee0c99f1bf7c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/07b1cc93b68340b787ee0c99f1bf7c68"}]}] Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 07b1cc93b68340b787ee0c99f1bf7c68 Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198290135 Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-TestMinimumBasicScenario-198290135-project Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: ee084e4a27a94d409653f36e786af9e7 Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-TestMinimumBasicScenario-198290135-project Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. Oct 11 13:36:03.145805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '38fb63c7-06cb-42a7-8f59-f6ec2b697eeb'} Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:36:03.146746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. Oct 11 13:36:03.148343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:03.150716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Returning 404 to user: Instance 38fb63c7-06cb-42a7-8f59-f6ec2b697eeb could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:36:03.151531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5cdee655-203b-4cfd-9cc8-1bf9af582b43 tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb" status: 404 len: 111 microversion: 2.1 time: 0.041847 Oct 11 13:36:03.152273 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 461/913] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:03 2022] GET /compute/v2.1/servers/38fb63c7-06cb-42a7-8f59-f6ec2b697eeb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:36:03.160849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9d0bda70-5540-4f18-9748-54ee049dc24f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] Calling method '.version_select at 0x7f7a551afca0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:03.180534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9d0bda70-5540-4f18-9748-54ee049dc24f tempest-TestMinimumBasicScenario-198290135 tempest-TestMinimumBasicScenario-198290135-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907073782" status: 202 len: 0 microversion: 2.1 time: 0.023409 Oct 11 13:36:03.181104 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 453/914] 10.222.0.15 () {58 vars in 1272 bytes} [Tue Oct 11 13:36:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907073782 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:36:11.729041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:11.729736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:11.737869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:11.738637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:11.739237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:11.740293 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:11.740909 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:11.741481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:11.768084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a99fcd91-6d34-45fc-bc84-35e60e686ad3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/ips" status: 200 len: 152 microversion: 2.20 time: 0.044593 Oct 11 13:36:11.768661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 462/915] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Oct 11 13:36:11 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:36:14.933741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=4 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:14.935000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=30 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:14.935718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:14.939817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:14.940379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:14.949373 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:14.949845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:14.950301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:14.950993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:14.951441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:14.951859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:14.975795 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lazy-loading 'flavor' on Instance uuid d48ad1ba-e872-4d90-b47f-df70821d655a {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:36:15.175846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cd8bb15b-f9ef-4a99-b3bc-a5d584a666b2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/action" status: 202 len: 0 microversion: 2.20 time: 0.243177 Oct 11 13:36:15.176471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 454/916] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 11 13:36:14 2022] POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:36:15.184836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:15.185370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:15.192098 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:15.192641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:15.193175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:15.193871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:15.194309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:15.194751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:15.324932 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:15.333100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:15.334582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:15.335730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9e4fd656-ad99-4ed6-89c7-faf751ce98eb tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.154829 Oct 11 13:36:15.336302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 463/917] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:15 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:16.366946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:16.367963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:16.379856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:16.380766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:16.381475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:16.382161 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:16.382612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:16.383077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:16.512622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:16.521279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:16.522928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:16.524196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6bca2e8a-5743-4c29-a521-a4340a5b7254 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.165378 Oct 11 13:36:16.524923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 455/918] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:16 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:17.554911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:17.555584 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:17.562874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:17.563380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:17.563833 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:17.564641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:17.565095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:17.565537 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:17.697493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:17.706234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:17.707678 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:17.708887 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-32af7d34-1479-46e5-a2fb-3d1c952ad1f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.160368 Oct 11 13:36:17.709441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 464/919] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:17 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:18.744508 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:18.745257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:18.753290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:18.753859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:18.754368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:18.755167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:18.755694 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:18.756222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:18.901817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:18.910604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:18.912065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:18.913282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-69e2b593-3b45-42eb-985b-ac200353039d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.175905 Oct 11 13:36:18.913818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 456/920] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:18 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:19.943925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:19.944994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:19.953219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:19.953699 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:19.954136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:19.954823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:19.955275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:19.955695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:20.089478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:20.100468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:20.101876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:20.103428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1d4b3975-ae84-44d9-bec6-04402252d3f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.166026 Oct 11 13:36:20.103980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 465/921] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:19 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:20.339009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1678360256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-169379414", "security_groups": [{"name": "tempest-secgroup-smoke-12488348"}], "networks": [{"uuid": "2e51d1a0-2fa3-4d7a-b707-9906b3676a1b"}], "block_device_mapping_v2": [{"uuid": "d6502d99-6026-4b46-bffb-cdcd2ffdb786", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:20.459387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] validate_networks() for [('2e51d1a0-2fa3-4d7a-b707-9906b3676a1b', None, None, None, None, None)] {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:36:20.831808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:36:20.832484 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:36:20.833218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:36:20.833730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:36:20.834351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:36:20.848004 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:20.848759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:20.849470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:20.850614 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:20.851410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:20.852089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:20.870064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Getting quotas for project 81282f5bd6b34d90afaba281d5bbc16b. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:36:20.874647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Getting quotas for user 983c742ffffe4a82a722eb1b1c23f971 and project 81282f5bd6b34d90afaba281d5bbc16b. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:36:20.930862 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:36:20.933062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6502d99-6026-4b46-bffb-cdcd2ffdb786',volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:36:21.078395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-43b040b9-18ea-4fef-b3dd-09df0d793133 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.743330 Oct 11 13:36:21.079210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 457/922] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:36:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:36:21.091676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ed95bd9f-8e86-4734-a36a-53cadd017259 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:21.092426 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ed95bd9f-8e86-4734-a36a-53cadd017259 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:21.130672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:21.131293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:21.138456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:21.138956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:21.139403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:21.140133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:21.140602 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:21.141019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:21.164681 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ed95bd9f-8e86-4734-a36a-53cadd017259 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:21.172556 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ed95bd9f-8e86-4734-a36a-53cadd017259 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1088 microversion: 2.1 time: 0.084996 Oct 11 13:36:21.180280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 466/923] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:21 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:21.528101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:21.537044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:21.538471 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:21.539639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e9ce291a-4afa-4087-8434-d3c53455fd5b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.414056 Oct 11 13:36:21.540203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 458/924] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:21 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:22.199393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:22.202162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:22.207610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:22.208108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:22.208591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:22.209266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:22.209756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:22.210184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:22.278386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:22.286811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a1670963-54c9-4fc7-808b-6729ecb91319 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1186 microversion: 2.1 time: 0.091461 Oct 11 13:36:22.287711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 467/925] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:22 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:22.565842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:22.566500 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:22.573955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:22.574433 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:22.574875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:22.575589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:22.576045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:22.576488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:22.743322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:22.753714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:22.755265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:22.756714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-19dc05b6-2ac3-4c43-8160-56b54a6134fa tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.195262 Oct 11 13:36:22.766978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 459/926] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:22 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:23.310896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:23.311479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:23.318647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:23.319127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:23.319557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:23.320320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:23.320768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:23.321183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:23.457668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:23.465767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3459ecde-6d0f-4832-b596-4aeb737b3ec0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.159113 Oct 11 13:36:23.466329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 468/927] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:23 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:23.670611 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:23.681445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:23.681920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:23.682337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:23.693927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] Creating event network-changed:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:36:23.699629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-fc29bc86-254e-475a-a4d2-5153c9e6d130 req-7f03c88f-02fb-4bb8-8086-c6f3c79f8362 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Oct 11 13:36:23.700440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 460/928] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:23.783039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:23.783680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:23.790170 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:23.790656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:23.791079 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:23.791824 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:23.792392 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:23.792820 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:23.925568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:23.933931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:23.935601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:23.936871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7d702c92-9e1d-45ce-bc95-861222132ea2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.157808 Oct 11 13:36:23.937426 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 469/929] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:23 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:24.493642 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:24.494842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:24.505547 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:24.506313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:24.507090 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:24.508282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:24.509055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:24.509771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:24.651887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:24.660223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6e51adab-900c-4205-95bc-0d716027a652 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.173747 Oct 11 13:36:24.660797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 461/930] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:24 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:24.962592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:24.963804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:24.970693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:24.971204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:24.971624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:24.972359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:24.972828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:24.973270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:25.104272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:25.112701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:25.114182 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:25.115389 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6abde3f3-8ad6-4677-8769-36c1a5d37f96 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.156826 Oct 11 13:36:25.115950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 470/931] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:24 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:25.687205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:25.688160 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:25.699445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:25.699948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:25.700430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:25.701133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:25.701598 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:25.702042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:25.845805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:25.854073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5da3d712-190a-459d-be86-a6890537b6d0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.173609 Oct 11 13:36:25.854655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 462/932] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:25 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:26.145895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:26.146794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:26.150685 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:26.157083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:26.157571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:26.158009 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:26.158713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:26.159180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:26.159610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:26.163203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:26.295131 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:26.307564 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:26.309605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:26.310796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-08b007fc-e042-4482-875b-a47a2668fa8f tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.171703 Oct 11 13:36:26.311359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 471/933] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:26 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:26.881454 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:26.882335 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:26.893993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:26.894816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:26.895534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:26.896875 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:26.897620 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:26.898358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:27.044102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:27.054822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-77d43efb-95a6-4676-8db7-1efe0b6ee89d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.180120 Oct 11 13:36:27.055401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 463/934] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:26 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:27.339928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:27.340944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:27.352050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:27.352908 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:27.353642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:27.354767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:27.355717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:27.356148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:27.492543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:27.501472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:27.502916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:27.504770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3b29eb2c-36a4-4b56-a0c7-e3e67e992783 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.171164 Oct 11 13:36:27.505937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 472/935] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:27 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:28.082180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:28.083111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:28.093977 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:28.094767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:28.095485 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:28.096684 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:28.097523 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:28.098383 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:28.239002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:28.246769 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d8e3c7ba-c33d-449a-8db9-c776f3aab047 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.171143 Oct 11 13:36:28.247338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 464/936] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:28 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:28.535268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:28.536414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:28.547178 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:28.547963 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:28.548733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:28.549856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:28.550600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:28.551302 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:28.684414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:28.692874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:28.694318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:28.695443 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-12bb3ddf-b243-4873-a93e-647609e8399d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.166691 Oct 11 13:36:28.696029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 473/937] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:28 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:29.274121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:29.275108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:29.283173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:29.283658 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:29.284097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:29.284837 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:29.285291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:29.285717 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:29.428310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:29.436660 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-67a383b7-5b94-42af-9dcb-6a08fdd6ce0e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.169062 Oct 11 13:36:29.437223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 465/938] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:29 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:29.725141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:29.726231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:29.735606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:29.736094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:29.736576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:29.737312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:29.737805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:29.738242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:29.873028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:29.881238 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:29.882674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:29.883835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2107c8f0-6045-41af-ae45-7a5c79a0f0fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.165268 Oct 11 13:36:29.884408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 474/939] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:29 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:30.463524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:30.464541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:30.475392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:30.476193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:30.477143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:30.478286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:30.479041 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:30.479752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:30.612232 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:30.620392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b5b6a95b-5845-4373-b515-435280414ccd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.163340 Oct 11 13:36:30.620960 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 466/940] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:30 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:30.913970 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:30.914826 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:30.925694 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:30.926536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:30.927252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:30.928459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:30.929198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:30.929898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:31.074374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:31.082559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:31.083996 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:31.085182 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-77043e1c-6728-4f06-8270-97ecec683873 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.177989 Oct 11 13:36:31.085736 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 475/941] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:30 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:31.645858 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:31.646657 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:31.649251 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:31.650128 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=6 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:31.657441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:31.657918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:31.658354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:31.659057 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:31.659505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:31.659923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:31.793315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:31.801535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d53c0fb0-901d-4bb4-ac46-8c557f257b4c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.160998 Oct 11 13:36:31.802100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 467/942] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:31 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:32.115218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:32.116070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:32.119139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:32.126371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:32.126835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:32.127276 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:32.128091 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:32.128580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:32.129002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:32.265621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:32.273976 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:32.275405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:32.276622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-256cacc2-ed17-45c0-9655-0dff6e769dfc tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.168184 Oct 11 13:36:32.277179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 476/943] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:32 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:32.829055 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:32.830075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:32.841140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:32.841575 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:32.842015 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:32.842727 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:32.843183 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:32.843613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:32.985050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:32.992879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-dcec78ee-adb8-4d09-bcfd-b883e4abb593 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.170761 Oct 11 13:36:32.993431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 468/944] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:32 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:33.306192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:33.307116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:33.318403 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:33.319202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:33.319938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:33.321144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:33.321866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:33.322581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:33.462928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:33.471422 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:33.473034 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:33.474187 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b503651b-2530-432f-8ff0-ac53db7c4953 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1744 microversion: 2.20 time: 0.174649 Oct 11 13:36:33.474754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 477/945] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:33 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:34.016625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:34.017237 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:34.024436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:34.024921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:34.025357 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:34.026060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:34.026518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:34.027011 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:34.163625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:34.167193 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:34.172152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-10a9cc8a-732d-4cbf-b9b7-ab16b7587536 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.159645 Oct 11 13:36:34.172716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 469/946] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:34 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:34.502983 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:34.503927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:34.515235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:34.516069 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:34.516845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:34.518046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:34.518771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:34.519479 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:34.654293 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:34.662998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:34.664549 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:34.665715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-52d4db81-af1b-44c8-ba8e-7d6e2f8ce030 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1744 microversion: 2.20 time: 0.169353 Oct 11 13:36:34.666316 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 478/947] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:34 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:35.201431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:35.202529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:35.213884 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.214696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.215422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.216624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.217078 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.217487 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.364814 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:35.373073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-283dc9b6-2b68-484d-b1c8-0b899160168d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.179091 Oct 11 13:36:35.373646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 470/948] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:35 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:35.695766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:35.696822 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:35.705589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.706069 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.706508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.707207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.707662 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.708088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.770382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:35.770974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:35.777316 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.777779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.778262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.778926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:35.779422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:35.779848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:35.805586 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d428aec1-58c3-45b8-a084-2b0fb3afa257 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/ips" status: 200 len: 149 microversion: 2.1 time: 0.039137 Oct 11 13:36:35.806186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 471/949] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:36:35 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:35.840336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:35.848665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:35.850103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:35.851265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-daff95f2-1c42-4805-afd4-b49c67dc4467 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1744 microversion: 2.20 time: 0.162210 Oct 11 13:36:35.851829 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 479/950] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:35 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:36.397344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:36.397918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:36.405377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:36.405861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:36.406309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:36.406989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:36.407439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:36.407861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:36.466404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "name": "network-vif-plugged", "status": "completed", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:36.476320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:36.476876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:36.477307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:36.493128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] Creating event network-vif-plugged:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:36:36.498626 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-0a5d4a7f-0912-4027-93fd-af37f3c0a954 req-c1a2c7ec-278b-4887-857f-98613817ab87 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036001 Oct 11 13:36:36.499421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 480/951] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:36:36.541070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:36.549088 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-08957170-900c-41e5-9f32-aab3333ec594 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.155863 Oct 11 13:36:36.549656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 472/952] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:36 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:36.882593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:36.883594 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:36.894360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:36.895148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:36.895911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:36.897104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:36.897839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:36.898535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:37.038127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:37.046992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:37.048470 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:37.049639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6ed0f106-e86e-4943-855a-5f0bfdcff748 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1744 microversion: 2.20 time: 0.175087 Oct 11 13:36:37.050204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 481/953] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:36 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:37.153141 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cc584f-1aa5-4dc7-8c86-0c0dfcecde68"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:37.155411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:37.161768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:37.162256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:37.162690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:37.163376 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:37.163828 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:37.164292 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:37.418768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-46f85bd2-cc3b-4d66-9a26-267dba1bc102 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269268 Oct 11 13:36:37.419390 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 473/954] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:36:37 2022] POST /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:37.573037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:37.573730 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:37.580412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:37.580977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:37.581431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:37.582134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:37.582582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:37.583020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:37.718854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:37.726978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1f3821d5-be1c-4041-9325-1bcfffcb9f7f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.158726 Oct 11 13:36:37.727557 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 482/955] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:37 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:38.082246 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:38.083728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:38.094465 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:38.095404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:38.095850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:38.096601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:38.097043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:38.097522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:38.235162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:38.243768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:38.245320 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:38.246838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1cf2b978-6362-4fe3-b2de-fe9483ddbd36 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1744 microversion: 2.20 time: 0.174607 Oct 11 13:36:38.247428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 474/956] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:38 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:38.544165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "name": "network-vif-plugged", "status": "completed", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:38.555134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:38.555618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:38.556052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:38.567671 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] Creating event network-vif-plugged:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:36:38.575488 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-32da4db4-14b1-4698-b293-d5f7b9d3bd7f req-07bfac85-adcf-450d-9530-1321220662b2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047784 Oct 11 13:36:38.576334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 483/957] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:38.750655 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:38.751147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:38.776149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:38.776739 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:38.777581 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:38.778637 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:38.779166 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:38.779597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:38.948358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:38.957105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4bb62fe2-7294-4825-ac03-65377d1e27a2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.210810 Oct 11 13:36:38.957955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 475/958] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:38 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:39.273809 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:39.274442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:39.281100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:39.281808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:39.282412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:39.283268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:39.283873 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:39.284484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:39.427523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:39.436467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:39.438197 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:39.439434 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-81a2cd26-16dd-4f96-be20-99892b2016c7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.170105 Oct 11 13:36:39.439990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 484/959] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:39 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:39.984780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:39.986109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:39.995401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:39.996294 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:39.996912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:39.997926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:39.998546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:39.998974 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:40.138227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:40.155200 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f3013149-c85c-45f8-9ab4-57562344c312 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1258 microversion: 2.1 time: 0.178298 Oct 11 13:36:40.155795 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 476/960] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:39 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:40.465776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:40.466597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:40.473654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:40.474138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:40.474608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:40.475318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:40.475771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:40.476335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:40.631554 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:40.643955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:40.645664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:40.647536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6f75c7d2-6c04-44d6-a0e3-afb55a94d1d5 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.185845 Oct 11 13:36:40.648431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 485/961] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:40 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:41.179135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:41.179770 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:41.186923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.187652 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.188290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.189162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.189808 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.190217 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.352150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:41.360715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-47236cda-8885-4ed8-8b3f-27e0feebba4f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1441 microversion: 2.1 time: 0.185817 Oct 11 13:36:41.378346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 477/962] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:41 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1441 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:41.386087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:41.386947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:41.396005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.396605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.397207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.397969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.398490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.398986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.573024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:41.581776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5b6cafd5-4571-4fc8-adc3-a490beed4d5f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1441 microversion: 2.1 time: 0.200623 Oct 11 13:36:41.582373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 486/963] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:41 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1441 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:41.675514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:41.676242 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:41.682844 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.683648 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.684260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.685141 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:41.685747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:41.686171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:41.919562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:41.929719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:41.931915 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:41.933584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ce08eeed-0a3a-4f8b-8dbf-49e014196403 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.262243 Oct 11 13:36:41.934653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 478/964] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:41 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:42.960475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:42.961691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:42.975880 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:42.976743 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:42.977511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:42.978526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:42.979145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:42.982876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:43.179022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:43.191007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:43.192531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:43.193828 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3f6fc7e5-4051-4f36-8b72-689acd187990 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.238538 Oct 11 13:36:43.201946 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 487/965] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:42 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:43.898629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:43.910719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:43.911367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:43.912226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:43.927451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] Creating event network-changed:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:36:43.935065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-e1642b5d-4fdc-4847-9f04-09efa5483621 req-bf9b91f6-9535-4604-bcb3-8ca314ed51cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Oct 11 13:36:43.941932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 479/966] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:44.219693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:44.220591 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:44.232331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:44.244576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:44.245151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:44.246632 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:44.247123 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:44.247661 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:44.425213 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:44.439460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:44.441989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:44.444226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f37e55cb-481b-4400-82fe-0b262836da8a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.228954 Oct 11 13:36:44.445295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 488/967] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:44 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:45.137613 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cc584f-1aa5-4dc7-8c86-0c0dfcecde68"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:45.140337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:45.143070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:45.149787 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.150619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.151276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.152248 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.152811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.153478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.261924 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: POST /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments HTTP/1.1 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 74 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:36:45.268647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {"volumeAttachment": {"volumeId": "63cc584f-1aa5-4dc7-8c86-0c0dfcecde68"}} Oct 11 13:36:45.271869 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'server_id': '783f4b57-ab72-4c26-90f3-b8c27d3b69e5', 'body': {'volumeAttachment': {'volumeId': '63cc584f-1aa5-4dc7-8c86-0c0dfcecde68'}}} Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:36:45.272902 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:45.274382 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:36:45.276712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 400 to user: Invalid volume: volume 63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 is already attached to instances: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:36:45.279348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d7b57888-de3d-447e-8a50-68567a9f7da7 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151328 Oct 11 13:36:45.284054 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 480/968] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:36:45 2022] POST /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments => generated 174 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:36:45.367225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:45.368748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:45.380966 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.381717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.382311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.383158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.383771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.384560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.388214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:45.475412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:45.476067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:45.485313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.485822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.486268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.486995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.487489 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.487847 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.496440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'services' on Instance uuid 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:36:45.601413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c85822e9-207c-40dd-94ac-a48a4ae1258d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments/63cc584f-1aa5-4dc7-8c86-0c0dfcecde68" status: 202 len: 0 microversion: 2.1 time: 0.238342 Oct 11 13:36:45.602445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 489/969] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:36:45 2022] DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments/63cc584f-1aa5-4dc7-8c86-0c0dfcecde68 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:36:45.629885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:45.633277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:45.643821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.644617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.645482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.646375 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:45.646989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:45.647580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:45.697378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-207e1307-6376-482c-86f0-2aaffa839369 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077313 Oct 11 13:36:45.699515 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 490/970] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:36:45 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:36:45.710854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:45.723176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:45.725350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:45.726551 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-18f82c44-0bee-4ee0-989f-2aeacba4a49a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.256102 Oct 11 13:36:45.727289 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 481/971] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:45 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:36:46.710778 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:46.713648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:46.720696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.721399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.721839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.722540 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.722993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.723416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.752849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:46.753656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:46.756041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f1f221cf-3b62-45e5-b36e-a314fbe20dee tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049368 Oct 11 13:36:46.763020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 491/972] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:36:46 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:36:46.763328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.763328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.763328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.763328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.767995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.768619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.840796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:46.841659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:46.848018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.848847 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.849980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.850920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:46.852722 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:46.854507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:46.892031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:36:46.923221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:46.933420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:46.936332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:46.938097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4e2d2a2e-b963-4799-adce-39fc7a7df7d8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.189175 Oct 11 13:36:46.956439 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 482/973] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:46 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:36:47.005189 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f703a618-af5d-48c4-8ecf-423d0cc3ef2d tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 204 len: 0 microversion: 2.1 time: 0.168016 Oct 11 13:36:47.005777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 492/974] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:36:46 2022] DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:36:47.014590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:47.015240 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:47.022069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:47.022588 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:47.023038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:47.023733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:47.024220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:47.024650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:47.171672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:47.179968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e12c26ce-1406-4333-9cfe-6e0aeb5e40ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1681 microversion: 2.1 time: 0.169791 Oct 11 13:36:47.196881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 483/975] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:47 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:36:47.969069 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:47.970978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:47.978133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:47.978669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:47.979345 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:47.980249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:47.980764 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:47.981305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:48.125428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:48.134208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:48.136179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:48.137467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-08dcedf0-65b3-46dd-b028-1b3213c39971 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.173138 Oct 11 13:36:48.153082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 493/976] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:47 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:48.203645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:48.204435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:48.211351 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:48.211834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:48.212298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:48.213009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:48.213466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:48.213883 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:48.375192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:48.383226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bdd000a0-4aee-482b-a99f-baf3a2b37784 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1681 microversion: 2.1 time: 0.184159 Oct 11 13:36:48.396715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 484/977] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:48 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:49.164551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:49.165249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:49.172495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:49.173050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:49.173576 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:49.174341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:49.174856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:49.175347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:49.308091 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:49.316532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:49.318025 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:49.319255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0bde1807-5312-4c5c-af61-c25ed2ce14c3 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1739 microversion: 2.20 time: 0.158746 Oct 11 13:36:49.319867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 494/978] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:49 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:49.407180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:49.407899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:49.414558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:49.415071 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:49.415506 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:49.416227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:49.416654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:49.417095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:49.486209 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:49.494432 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-0d6f75b9-cb4f-4afc-8f26-a939f683b435 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1613 microversion: 2.1 time: 0.091205 Oct 11 13:36:49.495256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 485/979] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:49 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:49.837609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "783f4b57-ab72-4c26-90f3-b8c27d3b69e5", "name": "network-vif-deleted", "tag": "455fa857-8f7f-4ce9-b151-eb6b9603d9f7"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:49.852037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:49.852613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:49.853046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:49.870321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] Creating event network-vif-deleted:455fa857-8f7f-4ce9-b151-eb6b9603d9f7 for instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 on hv-cinder-85061 Oct 11 13:36:49.876205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-65df33ed-62ae-4a61-ae06-d3f8a0663a2f req-c32f44d1-5b51-4a4a-ad0a-df673cd4e551 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043035 Oct 11 13:36:49.877898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 495/980] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:50.345013 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:50.345597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:50.351665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:50.352172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:50.352623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:50.353293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:50.353745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:50.354198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:50.358181 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:50.520049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:50.523083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:50.523784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:50.529179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:50.530628 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:50.531821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f6c66688-cdf6-42d3-927d-aa5bb087b344 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1721 microversion: 2.20 time: 0.190880 Oct 11 13:36:50.532418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 486/981] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:50 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:50.536378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:50.537051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:50.537525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:50.538236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:50.538688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:50.539109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:50.577467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:50.577992 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:50.578400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:50.578953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'fault' on Instance uuid 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:36:50.620592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:50.627725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8b1abb0b-460a-4724-9f64-7e212704261c tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 200 len: 1331 microversion: 2.1 time: 0.109335 Oct 11 13:36:50.628319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 496/982] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:50 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:51.563040 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:51.564087 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:51.574880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:51.575741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:51.576615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:51.577806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:51.578637 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:51.579447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:51.650947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:51.652188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:51.659038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:51.659438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:51.659867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:51.660589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:51.661060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:51.661455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:51.675704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 HTTP/1.1 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:36:51.678061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:36:51.679441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '783f4b57-ab72-4c26-90f3-b8c27d3b69e5'} Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:36:51.680628 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:36:51.682349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:36:51.685116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:36:51.685116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-de275386-2acc-4e19-92ec-17c5e3943478 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 404 len: 111 microversion: 2.1 time: 0.032427 Oct 11 13:36:51.685116 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 497/983] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:51 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:36:51.688353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-994b0b4b-b6e8-4e89-9a61-bcb9564b0383 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '.version_select at 0x7f7a55124280>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:51.707738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-994b0b4b-b6e8-4e89-9a61-bcb9564b0383 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411595144" status: 202 len: 0 microversion: 2.1 time: 0.023142 Oct 11 13:36:51.708351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 498/984] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 11 13:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411595144 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:36:51.719772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:51.728352 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:51.729799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:51.731001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-157b1819-f14b-479e-8790-0b4bf81307ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1721 microversion: 2.20 time: 0.174789 Oct 11 13:36:51.731565 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 487/985] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:51 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:52.335539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a1d43831-1798-42c0-947a-85166e6b99df tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: .version_select at 0x7f7a55105af0>, body: {"keypair": {"name": "tempest-keypair-1552799698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX9QxElcKvKRfpOXkqOWLJt1n2f2EvTIJBW3fOi2D4eSIr6thOq16U0gG8Nm0Hf3rs87UKInKFDHPVvLEQ0ap1ZlS5UZ7oY2wQ+bQbpZLP9r91MVFd/vxtrzHNWsH1x+A=="}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:52.352202 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a1d43831-1798-42c0-947a-85166e6b99df tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:36:52.356287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a1d43831-1798-42c0-947a-85166e6b99df tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'key_pairs'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:36:52.379391 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a1d43831-1798-42c0-947a-85166e6b99df tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047815 Oct 11 13:36:52.380215 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 499/986] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:36:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:52.520158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "name": "network-vif-unplugged", "status": "completed", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:52.532892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:52.533656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:52.534262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:52.566062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] Creating event network-vif-unplugged:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:36:52.571638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-303a4835-947d-43ab-9deb-cd567e3c60f8 req-b1384978-da78-44f5-9d68-363c290d11c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057604 Oct 11 13:36:52.575556 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 488/987] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:36:52.757007 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:52.757514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:52.763856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:52.764371 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:52.764800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:52.765490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:52.765934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:52.766356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:52.900497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:52.908605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:52.910027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:52.911193 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a3f0caca-2f68-4d07-b360-60ab02d36d61 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1664 microversion: 2.20 time: 0.158789 Oct 11 13:36:52.924306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 500/988] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:52 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:52.938379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8ce3f86-3e5f-4b20-a2d5-477087a3ab5c"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:52.940936 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:52.947256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:52.947977 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:52.948458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:52.949222 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:52.949679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:52.950105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.241422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-34b9b884-5e65-467f-8efe-4bd0183c01ee tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307691 Oct 11 13:36:53.242221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 489/989] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Oct 11 13:36:52 2022] POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 13:36:53.373267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:53.373751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:53.380995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.381861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.382613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.383868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.384903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.386039 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.650800 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7f43dcc8-d551-4f3d-a306-eac618c26035 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments/c8ce3f86-3e5f-4b20-a2d5-477087a3ab5c" status: 202 len: 0 microversion: 2.20 time: 0.281542 Oct 11 13:36:53.651401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 501/990] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Oct 11 13:36:53 2022] DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments/c8ce3f86-3e5f-4b20-a2d5-477087a3ab5c => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:36:53.717275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:53.717880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:53.724353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1413616893", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9ecb25f-434f-42aa-a99d-d1d2a47d24ff"}], "security_groups": [{"name": "tempest-securitygroup--1719298252"}], "key_name": "tempest-keypair-1552799698", "user_data": "}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:36:53.724529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.724993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.725428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.726142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.726596 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.727022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.771319 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118881) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 13:36:53.833319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] validate_networks() for [('f9ecb25f-434f-42aa-a99d-d1d2a47d24ff', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:36:53.843022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9c403715-6e08-4e6c-9b8e-152ab37d70d2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/action" status: 202 len: 0 microversion: 2.20 time: 0.129774 Oct 11 13:36:53.846887 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 490/991] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 11 13:36:53 2022] POST /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:36:53.851718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:53.852516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:53.859084 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.859639 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.860170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:53.860935 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:53.861823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:53.861948 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:54.101446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:54.110077 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:54.111520 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:54.112909 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-556a5204-e144-4454-9b04-20468dbb79ce tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1672 microversion: 2.20 time: 0.264919 Oct 11 13:36:54.113456 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 491/992] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:53 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:54.356043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:36:54.356492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:36:54.357059 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:36:54.357464 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:36:54.357865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:36:54.367133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:54.367607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:54.368043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:54.368782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:54.369330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:54.369780 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:54.390696 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:36:54.394783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Getting quotas for user 2fc3a4b9afd14409b3aef17f49aafd29 and project 659a7ca9a3684db4b6a29c780e7f8eb7. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:36:54.406138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:36:54.408551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:36:54.456775 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [33a0afe5-4269-43b3-9681-430a040777ba] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 13:36:55.139364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:55.140111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:55.146791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:55.147275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:55.147712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:55.148430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:55.148849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:55.149304 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:55.280281 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:55.288706 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:55.290155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:55.291287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-71009304-84a6-42d2-b4b1-90960a4f3967 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.156282 Oct 11 13:36:55.291850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 492/993] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:55 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:36:55.465516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [33a0afe5-4269-43b3-9681-430a040777ba] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50372. Oct 11 13:36:55.470435 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a38bd623-0a5c-4956-9630-d52f995eaa1a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.750461 Oct 11 13:36:55.471267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 502/994] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:36:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:36:55.482856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d07d83aa-2270-483f-9e5e-1f5c6069a56e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:55.483538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d07d83aa-2270-483f-9e5e-1f5c6069a56e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:55.554000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d07d83aa-2270-483f-9e5e-1f5c6069a56e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:55.561280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d07d83aa-2270-483f-9e5e-1f5c6069a56e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1242 microversion: 2.1 time: 0.082169 Oct 11 13:36:55.572147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 493/995] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:55 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:56.318590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:56.319204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:56.321276 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:56.327597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:56.328078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:56.328523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:56.329414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:56.329864 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:56.330349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:56.492804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:56.501542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:56.503011 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:56.504356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e4bce211-6816-4c1c-a1a2-7a9df479f6e7 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.190008 Oct 11 13:36:56.504972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 503/996] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:56 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:56.590965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:56.591640 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:56.598464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:56.598946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:56.599372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:56.600095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:56.600699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:56.601125 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:56.665392 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:56.673545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-42947f96-d6a3-4057-abf2-76697f6e5719 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.091751 Oct 11 13:36:56.674118 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 494/997] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:56 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:36:57.530717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:57.531344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:57.538164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:57.538743 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:57.539192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:57.539921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:57.540416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:57.540836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:57.561475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:36:57.687185 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:57.697257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:57.697794 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:57.697912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:57.698952 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:57.700501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a903a9f0-e389-4a27-9844-9545e6839513 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.174202 Oct 11 13:36:57.701644 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 504/998] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:57 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:57.704622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:57.705317 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:57.705926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:57.706782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:57.707389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:57.707969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:57.771741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:57.779565 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9b522798-64e2-4422-a235-80285d6d1847 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.086168 Oct 11 13:36:57.780276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 495/999] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:57 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:36:58.726845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:58.727482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:58.734558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:58.735042 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:58.735475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:58.736344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:58.736941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:58.737374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:58.803196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:58.804577 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:58.811644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:58.812256 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:58.812909 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:58.813806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:58.814265 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:58.814685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:58.893769 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:58.905529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9a3f59d9-7253-49e7-b78f-18dbbc7e37cf tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.106705 Oct 11 13:36:58.906296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 496/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:58 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:36:58.919589 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:58.934233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:58.935660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:36:58.936896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4ea971c5-0987-4d0e-bf94-a07048121218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.214012 Oct 11 13:36:58.940279 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 505/1001] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:58 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:36:59.933761 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:59.935257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:59.942223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:59.942705 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:59.943138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:59.943888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:59.944366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:59.944789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:59.963015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:36:59.964251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:36:59.971138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:59.971848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:59.972460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:36:59.973346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:36:59.973964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:36:59.974539 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:00.020824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:00.029494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1f421a2d-c6fc-4f1e-8061-fb354dc3b451 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.100311 Oct 11 13:37:00.031076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 497/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:36:59 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:00.135216 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:00.144094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:00.145571 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:00.146729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f965a102-0e80-4391-8193-03dfa5ad6218 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.187728 Oct 11 13:37:00.153217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 506/1003] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:36:59 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:37:01.057175 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:01.057788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:01.064926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:01.065413 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:01.065854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:01.066626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:01.067110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:01.067530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:01.133699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:01.142538 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e534ea98-c614-4143-bbc1-54d87d89cd17 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.089414 Oct 11 13:37:01.143139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 498/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:01 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:01.173235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:01.174044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:01.181646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:01.182162 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:01.182622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:01.183334 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:01.183786 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:01.184280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:01.319541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:01.327995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:01.329459 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:01.330620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d33d2bde-210c-4d35-951b-44fef400cbf1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.161567 Oct 11 13:37:01.331179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 507/1005] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:01 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:37:02.167159 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:02.168275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:02.175410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:02.176288 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:02.176918 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:02.177962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:02.178564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:02.179017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:02.245567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:02.253929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b979984d-c014-4f39-9c1b-8d24b5751603 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.091080 Oct 11 13:37:02.254618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 499/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:02 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:02.356254 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:02.357663 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:02.364640 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:02.365132 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:02.365593 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:02.366508 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:02.366962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:02.367527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:02.502955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:02.511773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:02.513619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:02.514884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2244e3d9-a109-46d2-9492-b6f63421b333 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.162668 Oct 11 13:37:02.515613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 508/1007] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:02 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:03.277116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:03.277852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:03.284532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:03.285019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:03.285451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:03.286150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:03.286604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:03.287028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:03.353121 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:03.356890 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:03.361733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b7bcb815-4595-422f-91a2-fd78a7937f2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.088549 Oct 11 13:37:03.362336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 500/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:03 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:37:03.541559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:03.542180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:03.549374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:03.549771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:03.550218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:03.550920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:03.551374 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:03.551803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:03.695839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:03.704468 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:03.705994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:03.707181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-16f1a42f-1201-44ab-9389-2ae7118f30be tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.169882 Oct 11 13:37:03.707966 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 509/1009] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:03 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 13:37:04.387790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:04.388517 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:04.396793 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:04.397282 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:04.397723 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:04.398440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:04.398894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:04.399325 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:04.466899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:04.475075 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-59bfb342-4907-4f35-989d-37fc0eb3402a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.093465 Oct 11 13:37:04.475636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 501/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:04 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:04.733324 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:04.733960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:04.735930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:04.736608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=10 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:04.743693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:04.744313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:04.744750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:04.745630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:04.746211 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:04.746717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:04.885543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:04.894808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:04.896346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:04.897530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-08331b77-3bde-44b5-b0a9-61dbfc1709fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.168363 Oct 11 13:37:04.898089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 510/1011] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:04 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:05.499925 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:05.500568 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:05.511412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:05.512103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:05.512700 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:05.513780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:05.514403 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:05.514990 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:05.560644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:05.578954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:05.587526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-46bc3df5-89be-465b-bf7c-111f6fe6ef80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.092962 Oct 11 13:37:05.588218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 502/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:05 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:05.923487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:05.924108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:05.930962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:05.931445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:05.931879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:05.932702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:05.933156 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:05.933577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:06.181876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:06.194198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:06.196108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:06.197929 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e4899969-1f82-4158-8a19-9c7b0a3746f2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.278138 Oct 11 13:37:06.198720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 511/1013] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:05 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:06.613820 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:06.614511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:06.624417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:06.625151 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:06.625772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:06.626629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:06.627080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:06.627512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:06.701290 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:06.709303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2365ca33-9967-4a8d-8393-d552f882c4f9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.100918 Oct 11 13:37:06.709859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 503/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:06 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:07.229613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:07.230608 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:07.241487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:07.242289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:07.243013 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:07.244172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:07.244968 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:07.245675 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:07.382063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:07.392214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:07.393650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:07.394811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e58c2649-4849-4fa1-b0da-5f6a25c53463 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.171844 Oct 11 13:37:07.395366 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 512/1015] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:07 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:07.736259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:07.736885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:07.744398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:07.744930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:07.745410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:07.746168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:07.746674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:07.747145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:07.809150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:07.816833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4215c768-2536-411d-b8f2-1fe917f50a62 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.086898 Oct 11 13:37:07.817355 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 504/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:07 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:08.421467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:08.422271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:08.429283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:08.429770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:08.430207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:08.430902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:08.431357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:08.431787 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:08.572181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:08.580850 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:08.582331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:08.583497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2bbe1b55-f67c-433c-b9e4-b90e4b5a86ff tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.166236 Oct 11 13:37:08.584151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 513/1017] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:08 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:08.844623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:08.845224 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:08.852076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:08.852584 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:08.853017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:08.853712 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:08.854157 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:08.854575 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:08.968768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:08.976989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f3fc4c0c-4ece-47d8-bfb3-652982a73a24 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.136583 Oct 11 13:37:08.977567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 505/1018] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:08 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:09.609237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:09.609842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:09.616765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:09.617253 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:09.617723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:09.618418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:09.618869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:09.619299 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:09.752973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:09.761482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:09.762904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:09.764051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8ef3ed50-d46e-4c6b-9879-4877b0e7e0fe tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.158818 Oct 11 13:37:09.764631 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 514/1019] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:09 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:10.004205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:10.005277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:10.016861 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:10.017346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:10.017806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:10.018511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:10.018969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:10.019393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:10.094825 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:10.103056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3ad8d914-3083-419f-884e-59c7b76cd1cd tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1238 microversion: 2.1 time: 0.105494 Oct 11 13:37:10.103619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 506/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:09 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1238 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:10.793753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:10.794663 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:10.803003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:10.803486 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:10.803920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:10.804665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:10.805120 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:10.805543 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:10.940848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:10.950400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:10.952509 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:10.953851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-decbb59f-d007-448f-927d-8a7754acb58c tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.166822 Oct 11 13:37:10.964181 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 515/1021] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:10 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:11.126374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:11.126993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:11.133908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.134397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.134833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:11.135959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.136478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.136920 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:11.181806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:11.182311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:11.188605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.189093 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.189526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:11.190214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.190674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.191081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:11.201241 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:11.209783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8ec24438-638e-4406-b622-5a9fcdd5a646 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1300 microversion: 2.1 time: 0.087525 Oct 11 13:37:11.210969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 507/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:11 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:11.217949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-eb47dce7-c7f1-47a2-a42d-73fad9f04c54 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/ips" status: 200 len: 146 microversion: 2.1 time: 0.039908 Oct 11 13:37:11.218957 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 516/1023] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:37:11 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:37:11.982192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:11.982826 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:11.989328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.989815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.990253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:11.990950 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:11.991741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:11.991906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.236359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:12.236950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:12.243398 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:12.243879 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:12.244362 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.245058 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:12.245497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:12.245918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.265270 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:12.273968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:12.275482 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:12.276744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f6ca4cd4-66fe-4fce-a490-a080eae14845 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.298593 Oct 11 13:37:12.277378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 508/1024] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:11 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:12.383259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:12.393027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b1acd3b3-13e3-46f7-9672-fd7f51b73d21 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.160775 Oct 11 13:37:12.393575 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 517/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:12 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:37:12.566199 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d029c1a6-eb7f-44a8-afb0-1270e1da329e"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:12.568901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:12.575254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:12.575741 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:12.576189 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.576909 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:12.577354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:12.577776 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.633872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d585cd70-c378-4330-91fb-3178ceea74ff", "tag": "3a34e586-5ef4-406f-b40a-613883e5a592"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:12.647196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:12.648604 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:12.649704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:12.672499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] Creating event network-changed:3a34e586-5ef4-406f-b40a-613883e5a592 for instance d585cd70-c378-4330-91fb-3178ceea74ff on hv-cinder-85061 Oct 11 13:37:12.679229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-1fcc04a7-57fa-407b-9e32-1fe82acb9531 req-6593794d-c15d-46d1-99b2-4ba37631f779 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048696 Oct 11 13:37:12.680320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 518/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:12.855916 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d182421d-ce8a-4c4e-a1ec-5a6220acd2e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293502 Oct 11 13:37:12.856733 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 509/1027] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:37:12 2022] POST /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:13.304214 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:13.304789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:13.311337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:13.311854 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:13.312327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:13.313049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:13.313538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:13.313965 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:13.417297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:13.418102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:13.424646 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:13.425110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:13.425544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:13.426249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:13.426703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:13.427132 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:13.444767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:13.453255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:13.454702 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:13.455869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-882dedaa-d7f7-4ed4-9050-30c62c5cfac8 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.156864 Oct 11 13:37:13.456489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 519/1028] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:13 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:13.562535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:13.570758 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1e9247d7-b1f3-4a4f-ae83-3c38404415a3 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.158132 Oct 11 13:37:13.571266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 510/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:13 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:14.485487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:14.486463 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:14.494511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:14.495049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:14.495535 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:14.496360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:14.496867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:14.497344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:14.593912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:14.594535 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:14.607134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:14.608000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:14.608677 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:14.609378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:14.609830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:14.610258 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:14.647149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:14.655640 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:14.657716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:14.659233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e81efada-0cf0-40ce-9f17-225118f9a589 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.180338 Oct 11 13:37:14.671315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 520/1030] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:14 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:14.678652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "name": "network-vif-plugged", "status": "completed", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:14.690205 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:14.690691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:14.691110 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:14.703338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] Creating event network-vif-plugged:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:37:14.708910 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-ffc84083-e3b2-4bfc-9e85-34a4fc353e44 req-a8a2484a-f20f-4258-bf01-bd18d0a614a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035600 Oct 11 13:37:14.709497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 521/1031] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:14.757008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:14.765099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-699ac8bd-d9eb-47c5-be57-b07331aecfc6 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.175242 Oct 11 13:37:14.765672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 511/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:14 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:37:15.685350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:15.686135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:15.693180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:15.693698 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:15.694218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:15.694973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:15.695718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:15.696335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:15.787978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:15.788608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:15.794910 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:15.796672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:15.797234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:15.797664 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:15.798430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:15.798870 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:15.799468 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:15.832169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:15.835785 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:15.841288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:15.842917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:15.844380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6429afb0-6b51-44ff-8b69-3ac0c9cbc30a tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.163329 Oct 11 13:37:15.845018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 522/1033] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:15 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:15.937797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:15.945780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c743d7aa-e39f-40c2-8765-b0cb7e5dde42 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.161631 Oct 11 13:37:15.946348 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 512/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:15 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:37:16.870620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:16.871258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:16.877955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:16.878489 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:16.878926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:16.879625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:16.880073 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:16.880523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:16.970387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:16.971030 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:16.978666 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:16.979171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:16.979611 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:16.980421 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:16.980849 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:16.981279 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:17.319149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:17.328146 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:17.329819 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:17.333683 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:17.338128 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-445d3b5a-81a0-42e6-bed2-740dead96e45 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1730 microversion: 2.20 time: 0.471868 Oct 11 13:37:17.352266 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 523/1035] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:16 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:17.354102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-098d89fd-313c-4689-ba24-bf8b25f14b2f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.388347 Oct 11 13:37:17.356810 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 513/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:16 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:18.366903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:18.367817 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:18.378865 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:18.379353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:18.379776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:18.380559 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:18.380993 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:18.381102 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:18.381507 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:18.381691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:18.390569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:18.391051 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:18.391455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:18.392172 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:18.392644 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:18.393069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:18.589327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:18.592499 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:18.599421 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:18.601298 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:18.601400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3ba46323-3857-4423-b168-67e400b739d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.225172 Oct 11 13:37:18.602327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ee5eb515-738f-45e9-9140-7d5ff28223fd tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1717 microversion: 2.20 time: 0.242057 Oct 11 13:37:18.603359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 524/1037] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:37:18 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:37:18.612346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 514/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:18 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:18.721693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d585cd70-c378-4330-91fb-3178ceea74ff", "name": "network-vif-plugged", "status": "completed", "tag": "3a34e586-5ef4-406f-b40a-613883e5a592"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:18.732287 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:18.732788 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:18.733318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:18.745792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] Creating event network-vif-plugged:3a34e586-5ef4-406f-b40a-613883e5a592 for instance d585cd70-c378-4330-91fb-3178ceea74ff on hv-cinder-85061 Oct 11 13:37:18.750851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-deded223-21f7-4b78-b1da-7bab15aeb3b9 req-7d1f2d27-2822-4248-b359-368adcf7f3cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033441 Oct 11 13:37:18.751445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 525/1039] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:37:19.632615 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:19.633221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:19.640529 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:19.641031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:19.641466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:19.642153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:19.642603 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:19.643029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:19.775916 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:19.788653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a7a35cea-be33-4bf7-a89a-79714ee2ba8f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1368 microversion: 2.1 time: 0.159698 Oct 11 13:37:19.789483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 515/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:19 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:20.817889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:20.818592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:20.824939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:20.825487 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:20.825929 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:20.826625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:20.827085 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:20.827544 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:20.962649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:20.975252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0e3329b8-b88e-46ad-9cd7-085c7bced68b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1557 microversion: 2.1 time: 0.162216 Oct 11 13:37:20.976034 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 526/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:20 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:21.000534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:21.001053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:21.009286 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:21.009775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:21.010532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:21.011225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:21.011679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:21.012108 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:21.015880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:21.093145 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-14eb9211-76aa-4285-a614-ae70ec2febc1 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098895 Oct 11 13:37:21.093824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 516/1042] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 11 13:37:20 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:22.265601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d585cd70-c378-4330-91fb-3178ceea74ff", "tag": "3a34e586-5ef4-406f-b40a-613883e5a592"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:22.277087 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:22.277819 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:22.278248 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:22.289566 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] Creating event network-changed:3a34e586-5ef4-406f-b40a-613883e5a592 for instance d585cd70-c378-4330-91fb-3178ceea74ff on hv-cinder-85061 Oct 11 13:37:22.294670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-e4bb124f-787e-4045-9d40-422386761870 req-78ac5f15-0b26-4c9e-9cca-4773c667dc3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Oct 11 13:37:22.295467 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 527/1043] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:22.599622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:22.602780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:22.610314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:22.611132 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:22.611734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:22.612636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:22.613243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:22.613879 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:22.646204 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-552fc3be-d359-4c30-a6b4-da7e956530bd tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050807 Oct 11 13:37:22.648451 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 517/1044] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:37:22 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:22.658563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:22.659670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:22.666635 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:22.667289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:22.667825 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:22.668672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:22.669417 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:22.669949 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:22.700740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-25080e79-e079-45aa-b4d7-69f867c7c6d1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e" status: 200 len: 194 microversion: 2.1 time: 0.046578 Oct 11 13:37:22.701677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 528/1045] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 11 13:37:22 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:24.137580 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddef511f-88b7-407c-8d53-c32ca2e8ac88"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:24.141123 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:24.148718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:24.149192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:24.149632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:24.150318 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:24.150769 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:24.151188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:24.405923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3d3caefd-420f-4831-bc0a-b9c137369756 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "POST /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274870 Oct 11 13:37:24.406525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 518/1046] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:37:24 2022] POST /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:31.987912 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:31.990211 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:31.992900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=52 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:37:31.998569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:31.999051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:31.999531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.000259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:32.000711 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:32.001141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.034320 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dcd3859c-1df8-4682-9a30-348f4d0d0a92 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050794 Oct 11 13:37:32.034884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 529/1047] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:37:31 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:32.187658 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:32.188297 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:32.195709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:32.196291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:32.196777 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.197553 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:32.198052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:32.198521 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.232963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-72710d2e-55fe-416d-aa4d-629ae5d8b3e8 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e" status: 200 len: 194 microversion: 2.1 time: 0.051472 Oct 11 13:37:32.233563 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 519/1048] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 11 13:37:32 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:32.246268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:32.246853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:32.253480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:32.253964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:32.254398 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.255089 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:32.255545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:32.255970 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:32.340264 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lazy-loading 'services' on Instance uuid 69d176db-faf6-433a-87b8-c43e7f9004e5 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:37:32.417731 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3bf2e08e-33f9-4b14-a747-14ea4c6e7158 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e" status: 202 len: 0 microversion: 2.1 time: 0.176767 Oct 11 13:37:32.418325 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 530/1049] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:37:32 2022] DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/d029c1a6-eb7f-44a8-afb0-1270e1da329e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:37:33.539247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:33.539830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:33.546704 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:33.547192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:33.547625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:33.548496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:33.548927 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:33.549472 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:33.580414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d8f220bf-2c71-4ce9-ac0e-08afc0372bfa tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/ddef511f-88b7-407c-8d53-c32ca2e8ac88" status: 200 len: 194 microversion: 2.1 time: 0.045086 Oct 11 13:37:33.581042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 520/1050] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 11 13:37:33 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/ddef511f-88b7-407c-8d53-c32ca2e8ac88 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:33.593019 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:33.593598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:33.599967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:33.600510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:33.600947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:33.601633 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:33.602081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:33.602505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:33.693399 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lazy-loading 'services' on Instance uuid 69d176db-faf6-433a-87b8-c43e7f9004e5 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:37:33.786681 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b14d043e-7fa1-462b-91ec-f65350860768 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/ddef511f-88b7-407c-8d53-c32ca2e8ac88" status: 202 len: 0 microversion: 2.1 time: 0.198536 Oct 11 13:37:33.787268 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 531/1051] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:37:33 2022] DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments/ddef511f-88b7-407c-8d53-c32ca2e8ac88 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:37:34.986774 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:34.989944 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:34.999654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.000395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.001025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.002043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.002623 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.003277 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.033985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-840a1e82-450f-44bf-983f-c7e3edb4fc44 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053706 Oct 11 13:37:35.034528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 521/1052] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:37:34 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:37:35.153335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:35.155619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:35.162300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.162787 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.163221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.163906 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.164388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.164815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.200306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a8a0da4f-6bed-4fac-9c53-662f2228402e tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051775 Oct 11 13:37:35.200994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 532/1053] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:37:35 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:37:35.267713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:35.268243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:35.274909 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.275399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.275834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.276558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.277009 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.277458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.302032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:37:35.391141 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-21dee3b2-c308-4d55-a32c-b7aeeaf31860 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 204 len: 0 microversion: 2.1 time: 0.126995 Oct 11 13:37:35.391728 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 522/1054] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:37:35 2022] DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:37:35.399867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:35.400522 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:35.406406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.406893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.407340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.408028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:35.408500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:35.408917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:35.543232 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:35.551513 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f2183942-d596-4e68-9b13-463e336b4bb7 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1673 microversion: 2.1 time: 0.155505 Oct 11 13:37:35.552104 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 533/1055] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:35 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:36.580107 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:36.581366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:36.594306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:36.595037 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:36.595475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:36.596216 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:36.596638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:36.597093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:36.728643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:36.736497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fe4d2a56-9698-4448-adb1-50f354c42c8b tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1673 microversion: 2.1 time: 0.163385 Oct 11 13:37:36.737072 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 523/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:36 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:37.760901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:37.761622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:37.768760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:37.769255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:37.769717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:37.770402 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:37.770858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:37.771304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:37.909428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:37.917694 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8a53acfa-0598-452d-9473-25e7481d62e2 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1673 microversion: 2.1 time: 0.161170 Oct 11 13:37:37.918277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 534/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:37 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:38.507361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d176db-faf6-433a-87b8-c43e7f9004e5", "name": "network-vif-deleted", "tag": "c7ede12d-65a1-43ab-a710-3d364fde6312"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:37:38.520963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:38.521782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:38.522259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:38.534430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] Creating event network-vif-deleted:c7ede12d-65a1-43ab-a710-3d364fde6312 for instance 69d176db-faf6-433a-87b8-c43e7f9004e5 on hv-cinder-85061 Oct 11 13:37:38.539477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-291220c1-a8a7-48ee-b646-b0f0a4d4370d req-f102f1ce-4100-4c09-b97e-25435ec8743c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035775 Oct 11 13:37:38.540507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 524/1058] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:37:38.941101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:38.941755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:38.948400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:38.948916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:38.949352 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:38.950046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:38.950501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:38.950914 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:38.982159 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:38.982619 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:38.983052 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:38.983493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.objects.instance [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lazy-loading 'fault' on Instance uuid 69d176db-faf6-433a-87b8-c43e7f9004e5 {{(pid=118880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:37:39.023532 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a84c1ffc4466687122a6c67536d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ec6c4b270341c5a4ebce407bb5cca9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:37:39.031569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6508032c-9275-46f2-84f2-79521d3d69e0 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 200 len: 1327 microversion: 2.1 time: 0.094341 Oct 11 13:37:39.032151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 535/1059] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:38 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:37:40.060047 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:40.061234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:40.071874 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:40.072404 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:40.072848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:40.073539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:40.073995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:40.074426 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:40.087912 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 HTTP/1.1 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:37:40.089566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:40.091116 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '69d176db-faf6-433a-87b8-c43e7f9004e5'} Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:37:40.091993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:40.093572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:40.094994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:37:40.094994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8efd6fdb-7df3-499e-9407-2227e7b61268 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 404 len: 111 microversion: 2.1 time: 0.038782 Oct 11 13:37:40.094994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 525/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:40 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:37:40.099885 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-177ac399-ea1a-4520-b8a3-1c26e65e1892 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '.version_select at 0x7f7a5514c430>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:40.121527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-177ac399-ea1a-4520-b8a3-1c26e65e1892 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883790448" status: 202 len: 0 microversion: 2.1 time: 0.025504 Oct 11 13:37:40.122076 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 536/1061] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 11 13:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883790448 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:37:43.029662 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:43.030179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:43.036994 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:43.037486 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:43.037932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:43.038629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:43.039058 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:43.039546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:43.052938 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 HTTP/1.1 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:37:43.054533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.056048 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '69d176db-faf6-433a-87b8-c43e7f9004e5'} Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:37:43.056965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.058381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.059791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:37:43.059791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8589b537-26c5-47a3-a152-66c3c459b9c1 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 404 len: 111 microversion: 2.1 time: 0.030129 Oct 11 13:37:43.059791 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 526/1062] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:37:43 2022] DELETE /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:37:43.064956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:43.065718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 69d176db-faf6-433a-87b8-c43e7f9004e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:43.072756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:43.073234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:43.073773 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:43.074460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:43.074913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:43.075336 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:43.088756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 HTTP/1.1 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:37:43.090438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.092071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '69d176db-faf6-433a-87b8-c43e7f9004e5'} Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:37:43.093061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. Oct 11 13:37:43.094590 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:43.095861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 69d176db-faf6-433a-87b8-c43e7f9004e5 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:37:43.095861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d664cb30-95d5-42f4-ad79-5866be6ca154 tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5" status: 404 len: 111 microversion: 2.1 time: 0.031388 Oct 11 13:37:43.095861 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 537/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:43 2022] GET /compute/v2.1/servers/69d176db-faf6-433a-87b8-c43e7f9004e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:37:44.254192 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:44.254708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:44.261818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:44.262309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:44.262746 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:44.263441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:44.263894 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:44.264363 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:44.277797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a HTTP/1.1 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:37:44.279386 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.280969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a'} Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:37:44.281846 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.283080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.284333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:37:44.284333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-98273bd0-09d5-4c22-9405-54fa607b1f3a tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 404 len: 111 microversion: 2.1 time: 0.030484 Oct 11 13:37:44.284333 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 527/1064] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:37:44 2022] DELETE /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:37:44.289337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:37:44.290000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] [instance: 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:37:44.296846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:44.297330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:44.297771 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:44.298466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:37:44.298926 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:37:44.299359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:37:44.312807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] HTTP exception thrown: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Request method failure captured: Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a HTTP/1.1 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW84mwo67jVnVS5tHOeci_jAbZU_pE14u4nO6M7dzbjMdrySFgyRIXJlJTWQIRA0mW-JBAgUI-EqfNOg1QvGIvpNFwfLq-kIN8nhqNaZAEugDe8HJzlv85CMzcI9vRQLMe4n1k9EG9VoJfBdlHj79kYIs4-l_OrNnKejxvW9g2vsPsk Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:37:44.314332 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33ec6c4b270341c5a4ebce407bb5cca9"}]}] Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 33ec6c4b270341c5a4ebce407bb5cca9 Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295248680 Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 9a4a84c1ffc4466687122a6c67536d9b Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeTestJSON-1295248680-project Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.315872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a'} Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:37:44.316748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. Oct 11 13:37:44.317995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:37:44.319095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] Returning 404 to user: Instance 9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:37:44.319095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7dfb3cba-6868-4aa6-87bd-3c0f6d063d6d tempest-AttachVolumeTestJSON-1295248680 tempest-AttachVolumeTestJSON-1295248680-project] 10.222.0.15 "GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a" status: 404 len: 111 microversion: 2.1 time: 0.030314 Oct 11 13:37:44.319095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 538/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:37:44 2022] GET /compute/v2.1/servers/9ddf2f01-9d22-4d9b-9a06-76d8c3b4d37a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:38:26.407998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:26.410331 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:26.412830 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:26.413532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:26.420757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.421390 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.421831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.422550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.423028 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.423452 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.456150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8e2e0a08-9d40-42ac-b792-8de860a36ca2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052183 Oct 11 13:38:26.456708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 528/1066] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 11 13:38:26 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:38:26.521429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:26.522018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:26.524484 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:26.525142 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:26.530748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.531252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.531668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.532393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.532846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.533271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.560394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:38:26.644173 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b07acb9d-8f17-40d4-a40c-a5e3e6d54f99 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 204 len: 0 microversion: 2.20 time: 0.126343 Oct 11 13:38:26.644798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 539/1067] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 11 13:38:26 2022] DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 13:38:26.653492 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:26.654105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:26.660327 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.660816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.661266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.661961 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:26.662417 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:26.662969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:26.796839 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:26.805524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:26.806959 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:26.808142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-11218fcc-4824-4f28-8a3f-79d2454b2b14 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.158623 Oct 11 13:38:26.808748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 529/1068] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:26 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:38:27.839418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:27.840478 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:27.851313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:27.852164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:27.852891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:27.854028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:27.854779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:27.855493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:27.997290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:28.005588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:28.007056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:28.008244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bbe6539d-c4bb-49fb-bcbb-ddc255777eb2 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1723 microversion: 2.20 time: 0.176414 Oct 11 13:38:28.008807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 540/1069] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:27 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:38:29.034400 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:29.035026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:29.041855 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:29.042344 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:29.042782 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:29.043479 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:29.043939 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:29.044398 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:29.108405 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:29.117134 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:29.118597 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd439d54a4f2348d78ddb84691f2a4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33afb7274a9146cdbee0eeb2e6f48785', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:38:29.119771 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-076b232f-3577-4ebd-aa18-db4c8b8e87f1 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 200 len: 1656 microversion: 2.20 time: 0.089370 Oct 11 13:38:29.120389 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 530/1070] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:29 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 13:38:29.370664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48ad1ba-e872-4d90-b47f-df70821d655a", "name": "network-vif-deleted", "tag": "43b1eb22-c616-4d3b-be1c-47d23dd87cd8"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:38:29.381466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:29.382242 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:29.382875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:29.397198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] Creating event network-vif-deleted:43b1eb22-c616-4d3b-be1c-47d23dd87cd8 for instance d48ad1ba-e872-4d90-b47f-df70821d655a on hv-cinder-85061 Oct 11 13:38:29.402857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-def65347-0e75-43b9-a13a-4cafb94350d9 req-72267bba-35e8-494d-997d-d82091190ae7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221988 Oct 11 13:38:29.406670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 541/1071] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:30.150502 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:30.151250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:30.158466 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:30.159032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:30.159539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:30.160532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:30.161350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:30.161946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:30.178923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a HTTP/1.1 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:38:30.181033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:30.182813 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'd48ad1ba-e872-4d90-b47f-df70821d655a'} Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:30.183748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:30.186195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:30.189215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:30.190271 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e8c7137f-e9d6-43c0-a1cb-2a8f6950bf08 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 404 len: 111 microversion: 2.20 time: 0.048406 Oct 11 13:38:30.190995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 531/1072] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:30 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 13:38:30.200342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-22558658-1bac-49fd-b2fc-976326c8838b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '.version_select at 0x7f7a55330670>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:30.221755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-22558658-1bac-49fd-b2fc-976326c8838b tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565836454" status: 204 len: 0 microversion: 2.20 time: 0.025566 Oct 11 13:38:30.222652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 542/1073] 10.222.0.15 () {60 vars in 1259 bytes} [Tue Oct 11 13:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565836454 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 13:38:32.021522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:32.022043 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:32.028873 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:32.029377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:32.029850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:32.030526 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:32.030991 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:32.031425 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:32.046264 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a HTTP/1.1 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:38:32.047816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.049550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'd48ad1ba-e872-4d90-b47f-df70821d655a'} Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:32.050453 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.051940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.053539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:32.053539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-890798ba-8869-4666-b9ca-57107df29b02 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 404 len: 111 microversion: 2.20 time: 0.031794 Oct 11 13:38:32.053539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 532/1074] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 11 13:38:32 2022] DELETE /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:38:32.058713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:32.059482 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: d48ad1ba-e872-4d90-b47f-df70821d655a] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:32.066458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:32.066941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:32.067383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:32.068075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:32.068572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:32.069046 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:32.082792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a HTTP/1.1 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:38:32.084480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.086126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'd48ad1ba-e872-4d90-b47f-df70821d655a'} Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:32.087048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. Oct 11 13:38:32.088572 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:32.089897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance d48ad1ba-e872-4d90-b47f-df70821d655a could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:32.089897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e0a75c25-5b92-4f8c-a9d3-89034553d632 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a" status: 404 len: 111 microversion: 2.20 time: 0.031989 Oct 11 13:38:32.089897 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 543/1075] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:32 2022] GET /compute/v2.1/servers/d48ad1ba-e872-4d90-b47f-df70821d655a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:38:33.245177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:33.245714 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:33.252557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:33.253045 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:33.253480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:33.254176 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:33.254632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:33.255056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:33.269080 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 HTTP/1.1 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:38:33.270672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.272092 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': 'fe7af4bf-c080-41e5-8b2d-e0a639122ad1'} Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:33.272906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.274377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.275816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:33.275816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6d3cdc21-030d-4d42-97e3-13588fe5666d tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 404 len: 111 microversion: 2.20 time: 0.031803 Oct 11 13:38:33.275816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 533/1076] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 11 13:38:33 2022] DELETE /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:38:33.280998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:33.281605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] [instance: fe7af4bf-c080-41e5-8b2d-e0a639122ad1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:38:33.288395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:33.288877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:33.289312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:33.290005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:38:33.290582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:38:33.291004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:38:33.304660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] HTTP exception thrown: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Request method failure captured: Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 HTTP/1.1 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8usjBm6kCunf5rl3qJ33UhXyKCBUbZvW45-bb2yzgmteD9M_WxWVPun2Vs3dtZQo_Y_DOTpzsmlvZTPeDubcQxckC9RXSyiuVIAoSrn4M8IjUQkeeZ85MMI2GIezsweu6bktfZzmjqDDCLfaX47D9cTtg80XNx5O8BqyXswuWaJJc Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:38:33.306226 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/33afb7274a9146cdbee0eeb2e6f48785"}]}] Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 33afb7274a9146cdbee0eeb2e6f48785 Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-525271075 Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: d439d54a4f2348d78ddb84691f2a4f63 Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-525271075-project Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.307789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'fe7af4bf-c080-41e5-8b2d-e0a639122ad1'} Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:33.308668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. Oct 11 13:38:33.310195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:33.311546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] Returning 404 to user: Instance fe7af4bf-c080-41e5-8b2d-e0a639122ad1 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:33.311546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2faab804-b473-415f-a8c1-79735aefe947 tempest-AttachVolumeShelveTestJSON-525271075 tempest-AttachVolumeShelveTestJSON-525271075-project] 10.222.0.15 "GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1" status: 404 len: 111 microversion: 2.20 time: 0.030641 Oct 11 13:38:33.311546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 544/1077] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 11 13:38:33 2022] GET /compute/v2.1/servers/fe7af4bf-c080-41e5-8b2d-e0a639122ad1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 13:38:38.500545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e6155077-9a11-48c6-8fa9-c9116f8a2e6e tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Action: 'create', calling method: .version_select at 0x7f7a55123d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1266028908"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:38:38.869352 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e6155077-9a11-48c6-8fa9-c9116f8a2e6e tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.515144 Oct 11 13:38:38.870866 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 534/1078] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Oct 11 13:38:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 517 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 13:38:38.885315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a177a700-4a6c-48b7-827b-914fefdb72d7 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a54e0bf70>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:38.960351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a177a700-4a6c-48b7-827b-914fefdb72d7 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 200 len: 345 microversion: 2.1 time: 0.080582 Oct 11 13:38:38.972400 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 545/1079] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:38:38 2022] GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:39.978440 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-23a65592-a076-4b29-bdb9-029357656500 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a552c9a60>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:40.028823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-23a65592-a076-4b29-bdb9-029357656500 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 200 len: 346 microversion: 2.1 time: 0.054894 Oct 11 13:38:40.029394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 535/1080] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:38:39 2022] GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:40.043198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d5d7113f-f6d4-4383-8c33-25d638dd3503 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Action: 'create', calling method: .version_select at 0x7f7a551f8700>, body: {"snapshot": {"volume_id": "674e6b69-03cc-4abe-9827-f6fa0380269e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-932558055"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:38:40.221338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d5d7113f-f6d4-4383-8c33-25d638dd3503 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.182658 Oct 11 13:38:40.221915 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 546/1081] 10.222.0.15 () {60 vars in 1162 bytes} [Tue Oct 11 13:38:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:40.233532 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ce9604e4-ad5e-400b-b49a-8bd6895bd42c tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551af430>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:40.271441 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ce9604e4-ad5e-400b-b49a-8bd6895bd42c tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.042228 Oct 11 13:38:40.273006 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 536/1082] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:40 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:40.286066 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6152fd60-1546-436f-895c-1711191c706e tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a55330670>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:40.333847 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6152fd60-1546-436f-895c-1711191c706e tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.052805 Oct 11 13:38:40.334431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 547/1083] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Oct 11 13:38:40 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:40.346012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c0bc7c5a-88c6-48ee-b3a9-c5ca4552b414 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a5517d820>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:40.379490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c0bc7c5a-88c6-48ee-b3a9-c5ca4552b414 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.036928 Oct 11 13:38:40.380177 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 537/1084] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:40 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:41.393660 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-23326da0-79b1-4f35-85e3-4566723666fd tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551f8f70>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:41.441904 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-23326da0-79b1-4f35-85e3-4566723666fd tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.052523 Oct 11 13:38:41.443188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 548/1085] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:41 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:42.456566 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b425b07c-ea8f-47e2-b7a0-019b0c44e9f7 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a554a0a60>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:42.494709 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b425b07c-ea8f-47e2-b7a0-019b0c44e9f7 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.043280 Oct 11 13:38:42.496397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 538/1086] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:42 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:43.511021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-55791035-87ed-4d36-b2e5-e21e5ff78b8a tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a550814c0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:43.536249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:43.537598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:43.582622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-55791035-87ed-4d36-b2e5-e21e5ff78b8a tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.078223 Oct 11 13:38:43.583423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 549/1087] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:43 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:44.575168 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=12 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:44.576021 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=24 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:38:44.594939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8d1c4133-2f8a-41da-b3dc-6bfdbc5ece01 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551133a0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:44.631977 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8d1c4133-2f8a-41da-b3dc-6bfdbc5ece01 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 287 microversion: 2.1 time: 0.040707 Oct 11 13:38:44.632790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 550/1088] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:44 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:44.644184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-82f3658c-6dfa-4f85-a0c1-0e93dbb8c771 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a553301f0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:44.705455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-82f3658c-6dfa-4f85-a0c1-0e93dbb8c771 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 202 len: 0 microversion: 2.1 time: 0.065008 Oct 11 13:38:44.706049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 551/1089] 10.222.0.15 () {58 vars in 1254 bytes} [Tue Oct 11 13:38:44 2022] DELETE /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:38:44.714195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-df457231-badb-497c-b8bf-828233f3016d tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551a29d0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:44.747498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-df457231-badb-497c-b8bf-828233f3016d tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 200 len: 286 microversion: 2.1 time: 0.036937 Oct 11 13:38:44.748413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 552/1090] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:44 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:38:44.780188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Action: 'create', calling method: .version_select at 0x7f7a554a0d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-620164794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjULzPyQ8tqsXHIbXH3FapjiJzqcZcy4M6kvxowTD3omEW/w4kvrc2TL6bl/RjcI1rdLuf4+KWqcewePjclEJNqwFFWggJk3abXstpwIDY+Cxly9EL008IZdt7pQJTjuw=="}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:38:44.795751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for project 340df5a9e41940d7b010168feb108bd3. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:38:44.799630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for user 76d8100e29a24533a014b8d073e45ca5 and project 340df5a9e41940d7b010168feb108bd3. Resources: {'key_pairs'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:38:44.812225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [17fffae8-7ba3-4e77-b719-b35f738477fb] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 13:38:45.762000 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de5dcc0f-4f9d-414e-9f49-31e73fa2c884 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a55113af0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:45.788296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-de5dcc0f-4f9d-414e-9f49-31e73fa2c884 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] HTTP exception thrown: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de5dcc0f-4f9d-414e-9f49-31e73fa2c884 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Request method failure captured: Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f HTTP/1.1 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHeuerEUL984vDSWlDDDTROLnnNdUwE9dCx82zW6Xj8fOAA5r45A9ZjehTi3x5kv59bvVeQ0kO6IGD11dSdoX8D75LuOG0mTe879RFi7IZe0M-R7fDQvqqSXRMhTURH0LrZqiXbpZgaTk3lGNoO2a-p_mfBsvS_tl8_c9HJoNceC_c Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:38:45.790492 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}] Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5f99b3f93c74cda827a6798d09e5118 Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '67470012-bad1-4c6f-b8b9-f786106e2f4f'} Oct 11 13:38:45.792198 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. (HTTP 404) (Request-ID: req-273e5696-b3fe-4cd8-a85e-23586dda8217) Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.793249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:45.794654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 13:38:45.795998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. Oct 11 13:38:45.797523 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:45.799134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-de5dcc0f-4f9d-414e-9f49-31e73fa2c884 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Returning 404 to user: Snapshot 67470012-bad1-4c6f-b8b9-f786106e2f4f could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:45.800014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-de5dcc0f-4f9d-414e-9f49-31e73fa2c884 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f" status: 404 len: 111 microversion: 2.1 time: 0.042863 Oct 11 13:38:45.800606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 553/1091] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:38:45 2022] GET /compute/v2.1/os-snapshots/67470012-bad1-4c6f-b8b9-f786106e2f4f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:38:45.809251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-fb579f3e-2ee5-45ec-b8a8-befffdb547df tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551a28b0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:45.820970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [17fffae8-7ba3-4e77-b719-b35f738477fb] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 51528. Oct 11 13:38:45.838215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c91386c8-0b29-47d0-ab14-d4c66097960c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.267406 Oct 11 13:38:45.838818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 539/1092] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 11 13:38:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:45.878790 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-fb579f3e-2ee5-45ec-b8a8-befffdb547df tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 202 len: 0 microversion: 2.1 time: 0.073343 Oct 11 13:38:45.879401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 554/1093] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:38:45 2022] DELETE /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:38:45.888259 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bc784b15-d415-4a33-8e4d-82594a030d3b tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551f9f70>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:45.937672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bc784b15-d415-4a33-8e4d-82594a030d3b tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 200 len: 345 microversion: 2.1 time: 0.053856 Oct 11 13:38:45.938411 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 540/1094] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:38:45 2022] GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:38:46.952869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0df59dfe-9fe1-4c8c-b2ee-ce1893a58ff2 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551131f0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:46.982118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-0df59dfe-9fe1-4c8c-b2ee-ce1893a58ff2 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] HTTP exception thrown: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0df59dfe-9fe1-4c8c-b2ee-ce1893a58ff2 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Request method failure captured: Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e HTTP/1.1 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHeuerEUL984vDSWlDDDTROLnnNdUwE9dCx82zW6Xj8fOAA5r45A9ZjehTi3x5kv59bvVeQ0kO6IGD11dSdoX8D75LuOG0mTe879RFi7IZe0M-R7fDQvqqSXRMhTURH0LrZqiXbpZgaTk3lGNoO2a-p_mfBsvS_tl8_c9HJoNceC_c Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:38:46.984936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}] Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5f99b3f93c74cda827a6798d09e5118 Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '674e6b69-03cc-4abe-9827-f6fa0380269e'} Oct 11 13:38:46.986448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. (HTTP 404) (Request-ID: req-330bc56a-6d21-4de3-94f7-f615a171d47f) Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:46.987346 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:46.988558 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 13:38:46.991149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0df59dfe-9fe1-4c8c-b2ee-ce1893a58ff2 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Returning 404 to user: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:46.993801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0df59dfe-9fe1-4c8c-b2ee-ce1893a58ff2 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 404 len: 109 microversion: 2.1 time: 0.037677 Oct 11 13:38:46.996612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 555/1095] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:38:46 2022] GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:38:47.002998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9536e959-442d-4c0b-8c75-577d91e105e1 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a552025e0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:47.033225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-9536e959-442d-4c0b-8c75-577d91e105e1 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] HTTP exception thrown: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9536e959-442d-4c0b-8c75-577d91e105e1 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Request method failure captured: Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e HTTP/1.1 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXHeuerEUL984vDSWlDDDTROLnnNdUwE9dCx82zW6Xj8fOAA5r45A9ZjehTi3x5kv59bvVeQ0kO6IGD11dSdoX8D75LuOG0mTe879RFi7IZe0M-R7fDQvqqSXRMhTURH0LrZqiXbpZgaTk3lGNoO2a-p_mfBsvS_tl8_c9HJoNceC_c Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:38:47.035185 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}] Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: b5f99b3f93c74cda827a6798d09e5118 Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '674e6b69-03cc-4abe-9827-f6fa0380269e'} Oct 11 13:38:47.036780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. (HTTP 404) (Request-ID: req-ed7d9be7-b5df-4019-bc3b-424ecbb4d564) Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.037720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 13:38:47.039167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 13:38:47.043000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9536e959-442d-4c0b-8c75-577d91e105e1 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Returning 404 to user: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:47.046032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9536e959-442d-4c0b-8c75-577d91e105e1 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 404 len: 109 microversion: 2.1 time: 0.037977 Oct 11 13:38:47.049444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 541/1096] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:38:46 2022] DELETE /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:38:47.049597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4a586982-5b2b-497a-b480-ccccb7e3db82 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Calling method '.version_select at 0x7f7a551a2c10>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:38:47.078106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-4a586982-5b2b-497a-b480-ccccb7e3db82 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] HTTP exception thrown: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4a586982-5b2b-497a-b480-ccccb7e3db82 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Request method failure captured: Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e HTTP/1.1 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHeuerEUL984vDSWlDDDTROLnnNdUwE9dCx82zW6Xj8fOAA5r45A9ZjehTi3x5kv59bvVeQ0kO6IGD11dSdoX8D75LuOG0mTe879RFi7IZe0M-R7fDQvqqSXRMhTURH0LrZqiXbpZgaTk3lGNoO2a-p_mfBsvS_tl8_c9HJoNceC_c Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:38:47.081622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4d5fd6aafa0a486b812d64ae0f6047d5"}]}] Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 4d5fd6aafa0a486b812d64ae0f6047d5 Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1463180559 Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: b5f99b3f93c74cda827a6798d09e5118 Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1463180559-project Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '674e6b69-03cc-4abe-9827-f6fa0380269e'} Oct 11 13:38:47.083445 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. (HTTP 404) (Request-ID: req-730764a0-580f-4eef-a5f0-8c0d17dfc69e) Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.084462 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:38:47.085874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 13:38:47.087380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4a586982-5b2b-497a-b480-ccccb7e3db82 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] Returning 404 to user: Volume 674e6b69-03cc-4abe-9827-f6fa0380269e could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:38:47.088807 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4a586982-5b2b-497a-b480-ccccb7e3db82 tempest-VolumesSnapshotsTestJSON-1463180559 tempest-VolumesSnapshotsTestJSON-1463180559-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e" status: 404 len: 109 microversion: 2.1 time: 0.045052 Oct 11 13:38:47.090836 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 556/1097] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:38:47 2022] GET /compute/v2.1/os-volumes/674e6b69-03cc-4abe-9827-f6fa0380269e => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:01.508940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=4 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:01.510557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:01.517180 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:01.517668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:01.525337 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:01.525815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:01.526257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:01.526937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:01.527387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:01.527802 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:01.552409 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ca607fff-00d6-4a3b-a3fd-382fc21f8a88 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.045780 Oct 11 13:39:01.552958 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 542/1098] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:39:01 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:03.967224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bd1e668-ef62-40da-84f4-bb7e3a251b42"}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:03.969806 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:03.978121 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:03.978588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:03.979020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:03.979718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:03.980184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:03.980606 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:04.237192 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-773577dd-05f1-40e3-b77e-8b27dea41d5b tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "POST /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274602 Oct 11 13:39:04.237978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 557/1099] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 11 13:39:03 2022] POST /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:05.501559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:05.502119 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:05.508665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:05.509148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:05.509589 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:05.510641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:05.511093 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:05.511514 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:05.534612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lazy-loading 'flavor' on Instance uuid 58398545-4e73-43e1-8691-2bd81d53c2eb {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:39:05.611919 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2d8e6fcd-cf37-4b02-83c7-6806e0876896 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "POST /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb/action" status: 202 len: 0 microversion: 2.1 time: 0.114183 Oct 11 13:39:05.612672 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 543/1100] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:39:05 2022] POST /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:39:05.622047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:05.622784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:05.629372 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:05.629848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:05.632188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:05.633339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:05.633814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:05.634396 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:05.774649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:05.783106 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9c450262-41a8-4323-80ce-b315692b5076 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.165715 Oct 11 13:39:05.783678 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 558/1101] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:05 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:06.813513 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:06.814713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:06.825498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:06.826291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:06.827017 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:06.828330 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:06.828796 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:06.829220 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:06.964250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:06.974796 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f244b912-d20c-4c68-804a-e0eab7c6f819 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.168932 Oct 11 13:39:06.975587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 544/1102] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:06 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:08.003041 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:08.004023 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:08.015518 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:08.016249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:08.016684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:08.017409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:08.017857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:08.018280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:08.158717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:08.170397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-99da7d40-3d4b-445b-adf7-68ccbcb63309 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.173743 Oct 11 13:39:08.171152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 559/1103] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:07 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:09.197557 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:09.198133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:09.207757 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:09.208430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:09.208941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:09.209882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:09.210521 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:09.211105 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:09.354083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:09.366003 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6d1e3156-a7ad-4be7-b669-479f7b100acd tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.174264 Oct 11 13:39:09.366898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 545/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:09 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:10.398086 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:10.399145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:10.409939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:10.410734 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:10.411454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:10.412648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:10.413440 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:10.414138 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:10.552431 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:10.560310 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-8efa42b3-6852-49f5-a676-f0f9d37bfca7 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.168897 Oct 11 13:39:10.560853 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 560/1105] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:10 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:11.582955 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:11.583559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:11.590459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:11.590941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:11.591372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:11.592065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:11.592546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:11.592963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:11.731384 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:11.741621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-771399a6-df98-46f6-9dfe-91bf70841544 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.162557 Oct 11 13:39:11.742253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 546/1106] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:11 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:12.765275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:12.766838 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:12.774920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:12.775455 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:12.775947 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:12.776749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:12.777503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:12.777991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:12.914694 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:12.923141 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5172a496-d4d5-4812-b6bc-cfb869b42895 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.161862 Oct 11 13:39:12.923903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 561/1107] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:12 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:13.947283 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:13.947756 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:13.950226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:39:13.950374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Tue Oct 11 13:39:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb (ip 10.222.0.15) !!! Oct 11 13:39:13.956629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:13.957293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:13.957778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:13.958871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:13.959464 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:13.960032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.084981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-957951053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620164794", "security_groups": [{"name": "tempest-secgroup-smoke-1462030698"}], "block_device_mapping_v2": [{"uuid": "70569b1b-5b67-49b8-a6e0-c3681aa95840", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "627df37d-77c7-4ff1-8964-bb0e3dd0d0a6"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:14.130811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:14.140899 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3c0afc83-12f9-446d-a7bd-af3f68a4bc64 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.197463 Oct 11 13:39:14.141827 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 547/1108] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:13 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:14.161725 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:14.162299 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:14.168430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.168921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.169364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.170062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.170516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.170946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.218081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] validate_networks() for [('627df37d-77c7-4ff1-8964-bb0e3dd0d0a6', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:39:14.254815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lazy-loading 'services' on Instance uuid d585cd70-c378-4330-91fb-3178ceea74ff {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:39:14.333622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d2a625a9-e122-4815-ac86-01615ad4401a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments/2bd1e668-ef62-40da-84f4-bb7e3a251b42" status: 202 len: 0 microversion: 2.1 time: 0.175397 Oct 11 13:39:14.334231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 548/1109] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 11 13:39:14 2022] DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments/2bd1e668-ef62-40da-84f4-bb7e3a251b42 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:39:14.343463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:14.345926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:14.352480 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.352975 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.353481 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.354143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.354594 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.355095 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.391713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-34febe0f-4154-4a5d-b816-fe155c51f2ea tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052575 Oct 11 13:39:14.392590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 549/1110] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:39:14 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:39:14.733088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:39:14.733719 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:39:14.734257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:39:14.734665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:39:14.735099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:39:14.744808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.745295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.745707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.746457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:14.746913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:14.747341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:14.765418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:39:14.770166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for user 76d8100e29a24533a014b8d073e45ca5 and project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:39:14.841140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:39:14.843324 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70569b1b-5b67-49b8-a6e0-c3681aa95840',volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:39:14.992648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3d391232-7643-4eae-9a5d-989d8f5f3325 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.913560 Oct 11 13:39:14.993503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 562/1111] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:39:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:39:15.004610 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1cd4aa92-b754-40fa-956c-a6249cc419a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:15.005617 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1cd4aa92-b754-40fa-956c-a6249cc419a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:15.076221 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1cd4aa92-b754-40fa-956c-a6249cc419a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:15.087171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1cd4aa92-b754-40fa-956c-a6249cc419a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1093 microversion: 2.1 time: 0.086267 Oct 11 13:39:15.087872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 550/1112] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:14 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:15.166380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:15.166962 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:15.173458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.174224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.174848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.175546 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.175995 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.176581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.328002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:15.336569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f96fdfe6-518d-46aa-9f24-85e2c72d9814 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.174509 Oct 11 13:39:15.337871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 563/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:15 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:15.405202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:15.407483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:15.420525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.421025 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.421463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.422162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.422688 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.423062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.459245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d7672c7d-34c7-4c95-83ce-f5386adb13ae tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058026 Oct 11 13:39:15.459817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 551/1114] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 11 13:39:15 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 13:39:15.526185 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:15.526716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:15.532838 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.533323 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.533779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.534437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.534896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.535321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.563084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:39:15.646604 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9de63ef0-5799-40f7-882e-943a594673d9 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 204 len: 0 microversion: 2.1 time: 0.124061 Oct 11 13:39:15.647393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 564/1115] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:15 2022] DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 13:39:15.655496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:15.656103 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:15.662231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.662710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.663148 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.663851 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:15.664347 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:15.664772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:15.799773 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:15.807781 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9c76cd90-2eb9-4a00-93c2-3c83f53d253a tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1682 microversion: 2.1 time: 0.156230 Oct 11 13:39:15.808379 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 552/1116] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:15 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:16.119063 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:16.120174 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:16.130235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.130720 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.131157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:16.131855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.132356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.132782 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:16.195137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:16.202928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e2acdefe-3eec-4c6f-a987-542401345ec3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1135 microversion: 2.1 time: 0.091499 Oct 11 13:39:16.203627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 565/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:16 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1135 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:16.361119 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:16.361703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:16.368545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.369029 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.369528 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:16.370144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.370601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.371044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:16.514751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:16.522683 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2cef05fe-a6ba-49af-b42b-803cc08aedb9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.165448 Oct 11 13:39:16.523255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 553/1118] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:16 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:16.831082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:16.831710 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:16.838288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.838770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.839203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:16.839989 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:16.840474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:16.840895 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:17.019762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:17.028527 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cc278851-a40a-4632-ae01-2b01838f39d2 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1682 microversion: 2.1 time: 0.201303 Oct 11 13:39:17.029689 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 566/1119] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:16 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:17.229991 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:17.230751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:17.237973 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:17.238968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:17.239558 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:17.240399 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:17.241005 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:17.241436 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:17.306152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:17.317594 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-38d8c359-04fc-4b1c-9023-58c455d25697 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1191 microversion: 2.1 time: 0.094860 Oct 11 13:39:17.319299 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 554/1120] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:17 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:17.546047 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:17.546666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:17.555783 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:17.556729 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:17.557438 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:17.558676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:17.559493 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:17.560065 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:17.807239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:17.828442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-190ed992-c790-4f2b-a20e-433e107dd5e0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.286176 Oct 11 13:39:17.829048 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 567/1121] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:17 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:18.056247 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:18.057797 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:18.064495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.065243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.065744 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:18.066424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.066898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.067636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:18.242932 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:18.253368 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f15afd23-687c-4762-b531-195b6edbc5fc tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1682 microversion: 2.1 time: 0.203575 Oct 11 13:39:18.254463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 555/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:18 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:18.345732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:18.346556 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:18.352587 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.353257 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.353938 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:18.354637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.355084 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.355500 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:18.419503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:18.428481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-7ede95e5-adcf-4d9b-8a0c-2053263a1dbb tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1197 microversion: 2.1 time: 0.086734 Oct 11 13:39:18.429061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 568/1123] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:18 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:18.853138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:18.854178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:18.861737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.862720 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.863156 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:18.864010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:18.864590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:18.865042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.010665 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:19.019699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a8e632d6-058e-4698-a8c1-525e4a6dad3a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.171639 Oct 11 13:39:19.020732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 556/1124] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:18 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:19.282448 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:19.283795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:19.292769 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:19.293602 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:19.294335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.295588 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:19.296347 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:19.297666 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.358901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d585cd70-c378-4330-91fb-3178ceea74ff", "name": "network-vif-deleted", "tag": "3a34e586-5ef4-406f-b40a-613883e5a592"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:19.378684 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:19.378989 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:19.379512 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.397186 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:19.405094 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc3a4b9afd14409b3aef17f49aafd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659a7ca9a3684db4b6a29c780e7f8eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:19.424529 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cb678fc1-2530-45cb-b1cc-e8ad57e42a2e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 200 len: 1614 microversion: 2.1 time: 0.148869 Oct 11 13:39:19.425585 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 569/1125] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:19 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 1614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:19.435507 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] Creating event network-vif-deleted:3a34e586-5ef4-406f-b40a-613883e5a592 for instance d585cd70-c378-4330-91fb-3178ceea74ff on hv-cinder-85061 Oct 11 13:39:19.460381 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-cfc2e7c7-2bb9-4070-a740-db0167e1f4bd req-3d06c457-6fb3-4ac2-b9d3-a94ee81dac0b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104840 Oct 11 13:39:19.462222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:19.463129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:19.463503 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 557/1126] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:19.474928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:19.475951 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:19.477359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.478604 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:19.479285 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:19.479955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:19.665453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:19.683798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-379cd262-1261-4d3d-9ac7-7c2d5e84afe2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.227795 Oct 11 13:39:19.687134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 570/1127] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:19 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:20.044679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:20.046126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:20.056625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.057495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.058625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.059525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.060579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.061203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.254254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:20.266197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2551db17-74cc-464e-9aad-a30d7cbc53b9 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.226373 Oct 11 13:39:20.267395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 558/1128] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:20 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:20.713210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:20.713923 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:20.725407 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.726305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.727463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.728656 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.737668 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.740018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.748378 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:20.749072 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:20.770290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.772031 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.772525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.774476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:20.778931 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:20.779618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:20.788184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:20.815835 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff HTTP/1.1 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:20.817676 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:20.819964 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'd585cd70-c378-4330-91fb-3178ceea74ff'} Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:20.821002 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:20.822353 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:20.823637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:20.823637 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-300d1ca0-803d-43a0-9433-18708b9ff72f tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 404 len: 111 microversion: 2.1 time: 0.371504 Oct 11 13:39:20.835158 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 571/1129] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:20 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 111 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:20.841997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ef30da78-f18b-427c-b31a-c24b662fab43 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '.version_select at 0x7f7a551a2790>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:20.872542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ef30da78-f18b-427c-b31a-c24b662fab43 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552799698" status: 202 len: 0 microversion: 2.1 time: 0.034229 Oct 11 13:39:20.873842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 572/1130] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 11 13:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1552799698 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:39:21.006548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:21.022917 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-de17db23-f629-4f12-977e-7cee7f06ee65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.314351 Oct 11 13:39:21.024178 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 559/1131] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:20 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:21.228295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:21.241811 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.242370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.242998 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.259707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.compute.server_external_events [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] Unable to find a host for instance 58398545-4e73-43e1-8691-2bd81d53c2eb. Dropping event network-vif-unplugged {{(pid=118880) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 13:39:21.261360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-363a5bc3-3586-4c19-8d75-eb9bf7f6ee92 req-3d21cc5d-5ac8-41f9-b8be-4555ac11696b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037043 Oct 11 13:39:21.262290 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 573/1132] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 13:39:21.290367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:21.290983 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:21.297137 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.297587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.298254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.299152 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.299774 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.300462 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.458109 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:21.466046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8814333a-1d64-4ec8-bf1b-b877bb430739 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1506 microversion: 2.1 time: 0.179667 Oct 11 13:39:21.466619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 560/1133] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:21 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:21.482289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fd6149-adef-4c98-87b0-2744d039d0cb", "tag": "7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:21.493336 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:21.493963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:21.500246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.500732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.501163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.501370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.502815 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.503262 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.504590 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.505395 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.505977 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.513129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] Creating event network-changed:7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab for instance 39fd6149-adef-4c98-87b0-2744d039d0cb on hv-cinder-85061 Oct 11 13:39:21.522090 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-80f07960-c8e1-43af-8058-36c28509cff7 req-f1f0d018-d4c3-436a-ad7b-0c2f491f530f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044055 Oct 11 13:39:21.522907 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 574/1134] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:39:21.541641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118881) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 13:39:21.620716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d563888d-28a9-4009-931a-06ccf26b1bd2 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "POST /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb/action" status: 202 len: 0 microversion: 2.1 time: 0.131104 Oct 11 13:39:21.621229 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 561/1135] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 11 13:39:21 2022] POST /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:39:21.630481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:21.631499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:21.639999 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.640531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.641534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.642221 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:21.642852 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:21.643538 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:21.804416 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:21.812928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-24ac02ef-1525-4a74-bd3b-f06b584808eb tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1514 microversion: 2.1 time: 0.187072 Oct 11 13:39:21.813495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 575/1136] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:21 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:22.051491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:22.052197 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:22.060372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.060865 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.061298 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.062065 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.062505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.063111 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.239284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:22.248069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-53885684-290b-449f-8c3f-482017a0d235 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.204786 Oct 11 13:39:22.248674 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 562/1137] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:22 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:22.829088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:22.829875 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:22.836578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:22.836776 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.837064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.837234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:22.837505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.838410 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.838862 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.839270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.843096 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.843573 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.844010 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.845605 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.846049 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.846669 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.853647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff HTTP/1.1 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:22.855404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.857101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'd585cd70-c378-4330-91fb-3178ceea74ff'} Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:22.857876 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.859134 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.861021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:22.861021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-dc0f326c-1e7b-47fc-b33f-a5bc5bc3490e tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 404 len: 111 microversion: 2.1 time: 0.031736 Oct 11 13:39:22.861021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 576/1138] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:22 2022] DELETE /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:22.865823 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:22.866454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: d585cd70-c378-4330-91fb-3178ceea74ff] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:22.872709 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.873315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.873755 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.874516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:22.874973 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:22.875398 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:22.890038 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff HTTP/1.1 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:22.891600 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.893247 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'd585cd70-c378-4330-91fb-3178ceea74ff'} Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:22.894219 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. Oct 11 13:39:22.895768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:22.897165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance d585cd70-c378-4330-91fb-3178ceea74ff could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:22.897165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e2e1e2c7-6438-4d12-bd49-5b3e0ae04c80 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff" status: 404 len: 111 microversion: 2.1 time: 0.031437 Oct 11 13:39:22.897165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 577/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:22 2022] GET /compute/v2.1/servers/d585cd70-c378-4330-91fb-3178ceea74ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:39:22.987986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:22.996691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ab0f58ef-2bd7-458e-ac3c-fd7726a27b6d tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1516 microversion: 2.1 time: 0.164378 Oct 11 13:39:23.006476 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 563/1140] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:22 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:23.283929 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:23.284614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:23.291236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:23.291725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:23.292228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:23.292933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:23.293388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:23.293812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:23.432465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:23.441044 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-064301d1-2dce-4dd0-821d-7d02caf505b0 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.161988 Oct 11 13:39:23.441674 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 578/1141] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:23 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:24.023026 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.024914 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.037928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.037928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.037928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.037928 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.038585 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.039083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.042985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.044148 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.051646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.052420 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.053035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.054092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.054723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.055381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.070207 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 HTTP/1.1 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:24.072447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.074224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '783f4b57-ab72-4c26-90f3-b8c27d3b69e5'} Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:24.075169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.076723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.079035 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:24.079958 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-157c6af4-3ca7-4883-b8d3-00631be26a86 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 404 len: 111 microversion: 2.1 time: 0.040864 Oct 11 13:39:24.081108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 579/1142] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:24 2022] DELETE /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:24.090694 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.091531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: 783f4b57-ab72-4c26-90f3-b8c27d3b69e5] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.098029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.098534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.098980 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.099688 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.100259 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.100687 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.117150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 HTTP/1.1 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:24.118766 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.120196 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '783f4b57-ab72-4c26-90f3-b8c27d3b69e5'} Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:24.121188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. Oct 11 13:39:24.122777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.124415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance 783f4b57-ab72-4c26-90f3-b8c27d3b69e5 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:24.124415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-35c40384-b8d8-4fd0-9ae5-3ea2b4bd7086 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5" status: 404 len: 111 microversion: 2.1 time: 0.035042 Oct 11 13:39:24.124415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 580/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:24 2022] GET /compute/v2.1/servers/783f4b57-ab72-4c26-90f3-b8c27d3b69e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:24.129331 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.129918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.136335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.136900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.137428 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.138201 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.138732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.139220 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.153370 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: DELETE /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 HTTP/1.1 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:24.155055 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.156562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'f16d3793-e4d8-4a6b-8cba-9e0e20d70722'} Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:24.157327 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.158691 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.161592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:24.162625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-57169790-4297-4203-89ed-c49d79359088 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 404 len: 111 microversion: 2.1 time: 0.037061 Oct 11 13:39:24.166114 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 581/1144] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:24 2022] DELETE /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:24.170974 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.171649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: f16d3793-e4d8-4a6b-8cba-9e0e20d70722] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.177740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.178277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.178953 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.179871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.180562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.180990 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.196312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 HTTP/1.1 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:24.198893 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.200330 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'f16d3793-e4d8-4a6b-8cba-9e0e20d70722'} Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:24.201108 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. Oct 11 13:39:24.205497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:24.207180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance f16d3793-e4d8-4a6b-8cba-9e0e20d70722 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:24.207180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-43925589-ccbd-4aff-821f-910bab3238a8 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722" status: 404 len: 111 microversion: 2.1 time: 0.033254 Oct 11 13:39:24.207180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 582/1145] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:24 2022] GET /compute/v2.1/servers/f16d3793-e4d8-4a6b-8cba-9e0e20d70722 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:24.255708 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:24.264354 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a0f80cbf-a7b0-475e-9fd7-49a28d0b690c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.245713 Oct 11 13:39:24.275970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 564/1146] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:24 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:24.465068 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:24.465686 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:24.472474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.472960 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.473401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.474209 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:24.474686 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:24.475112 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:24.621550 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:24.629466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1f3a3de6-6135-46b7-9dbd-faaf1fca29ee tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.168167 Oct 11 13:39:24.630026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 583/1147] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:24 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:25.291117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:25.291901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:25.294789 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:25.300745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.301332 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.301772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.302636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.303364 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.303713 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.368801 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:25.369340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:25.371292 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:25.371933 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:25.378659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.379137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.379569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.380285 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.380727 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.381140 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.396369 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 HTTP/1.1 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:25.397979 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.399680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'c2ec8e2f-5c8c-414b-acec-852608b2e0f2'} Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:25.400805 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.402413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.404249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:25.404249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2d763924-b6b5-4d2d-9fd5-1f2e0f1c1a30 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 404 len: 111 microversion: 2.1 time: 0.034534 Oct 11 13:39:25.404249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 584/1148] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:25 2022] DELETE /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:39:25.407328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:25.407901 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] [instance: c2ec8e2f-5c8c-414b-acec-852608b2e0f2] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:25.418466 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.419003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.419442 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.420199 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.420830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.421237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.436139 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] HTTP exception thrown: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Request method failure captured: Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 HTTP/1.1 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRW8wPqcyhUSeKMLe-cKFiJXpcMa20E8NaHcVRyKEDaDWy2PFT5tF_ia1NiHhsRHGX1HkcyBqYNfxg9ehaOkOddT92G3mkatmytQN8OR7h1OpRJBuTL3bvMXo4FWCmn3kjM_ENanBX-C3ALIXEpWlWxqZbbGB7378T6q0RZconSwULw8 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:25.437814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/659a7ca9a3684db4b6a29c780e7f8eb7"}]}] Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 659a7ca9a3684db4b6a29c780e7f8eb7 Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131994643 Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 2fc3a4b9afd14409b3aef17f49aafd29 Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-AttachVolumeNegativeTest-2131994643-project Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.439171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'c2ec8e2f-5c8c-414b-acec-852608b2e0f2'} Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:25.439936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. Oct 11 13:39:25.441233 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:25.443301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] Returning 404 to user: Instance c2ec8e2f-5c8c-414b-acec-852608b2e0f2 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:25.443301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e6635427-9ed9-4fad-b355-d49dc59c5f01 tempest-AttachVolumeNegativeTest-2131994643 tempest-AttachVolumeNegativeTest-2131994643-project] 10.222.0.15 "GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2" status: 404 len: 111 microversion: 2.1 time: 0.035489 Oct 11 13:39:25.443609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 585/1149] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:25 2022] GET /compute/v2.1/servers/c2ec8e2f-5c8c-414b-acec-852608b2e0f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 13:39:25.494416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:25.503853 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-703ee2fa-302e-4761-9c93-893c7dacb6e3 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.218594 Oct 11 13:39:25.504676 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 565/1150] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:25 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:25.652781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:25.653718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:25.659959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.660726 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.661217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.662125 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:25.662793 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:25.663321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:25.813954 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:25.822432 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-27693d75-e9ec-4337-ae98-f753992a0d7b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.173490 Oct 11 13:39:25.823277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 586/1151] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:25 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:26.528878 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:26.529697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:26.536477 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:26.537060 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:26.537682 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:26.538605 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:26.539396 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:26.540042 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:26.717908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:26.727428 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-59ac7896-7520-4110-95d1-9114601dab43 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.202644 Oct 11 13:39:26.728022 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 566/1152] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:26 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:26.846510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:26.847713 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:26.854744 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:26.855441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:26.855877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:26.856812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:26.857260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:26.857695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:26.999580 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:27.007839 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e4d0e07f-e3c9-43b6-8c3b-1d2847f7c0f8 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.165394 Oct 11 13:39:27.008454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 587/1153] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:26 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:27.751740 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:27.753056 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:27.760302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:27.760811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:27.761241 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:27.761913 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:27.762350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:27.762946 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:27.936242 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:27.945140 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-5661896f-0fa2-4c84-959f-e278dfca4514 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.197277 Oct 11 13:39:27.953250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 567/1154] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:27 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:28.032725 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:28.033472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:28.041240 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:28.041927 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:28.042536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:28.043596 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:28.044429 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:28.045004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:28.201624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:28.209849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a9debd5c-7293-44b5-ac0f-e7d1aa2c0dfa tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.182705 Oct 11 13:39:28.210437 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 588/1155] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:28 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:28.968483 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:28.969041 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:28.975487 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:28.975970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:28.976443 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:28.977135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:28.977587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:28.978012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:29.140671 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:29.156064 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-108a7db0-682b-4860-ac06-a1e5ed86815f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.191570 Oct 11 13:39:29.156870 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 568/1156] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:28 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:29.234490 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:29.235816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:29.243603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:29.244097 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:29.244677 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:29.245384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:29.245830 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:29.246263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:29.403513 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:29.411940 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-3af693a1-9b60-467f-a3a8-f0e1db5793a5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.182625 Oct 11 13:39:29.412620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 589/1157] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:29 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:30.148310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6491195b-40e4-49cf-a044-a980ef972fd8 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Action: 'create', calling method: .version_select at 0x7f7a551f9af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-193609154", "metadata": {"Type": "work"}}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:30.179227 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:30.179955 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:30.186296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:30.187026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:30.187542 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:30.188335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:30.188857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:30.189350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:30.327525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:30.335779 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5dad57be-fd53-46f3-bdc2-5a849fb15a2b tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.160521 Oct 11 13:39:30.336394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 590/1158] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:30 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:30.435077 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:30.435913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:30.443717 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:30.444498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:30.445118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:30.446877 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:30.447338 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:30.447765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:30.458724 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6491195b-40e4-49cf-a044-a980ef972fd8 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.429098 Oct 11 13:39:30.459645 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 569/1159] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 11 13:39:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 13:39:30.473675 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-fcc464d1-79f8-47e5-a22e-94fe09dc26a2 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a552f35e0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:30.526002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-fcc464d1-79f8-47e5-a22e-94fe09dc26a2 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 352 microversion: 2.1 time: 0.056065 Oct 11 13:39:30.527173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 570/1160] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:30 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:30.592659 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:30.601004 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-925dea58-98fa-4049-98af-102df5a1fcf5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.169950 Oct 11 13:39:30.601624 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 591/1161] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:30 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:31.360424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:31.361021 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:31.367831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:31.368349 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:31.368790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:31.369488 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:31.369940 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:31.370367 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:31.507781 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:31.515951 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6382c0e4-cb82-47a1-afe4-a1e5fc973ae1 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.160729 Oct 11 13:39:31.516543 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 571/1162] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:31 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:31.540987 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-5332d168-0885-41ef-a46e-dd09f0569b0a tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a55113af0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:31.596656 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-5332d168-0885-41ef-a46e-dd09f0569b0a tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 352 microversion: 2.1 time: 0.059572 Oct 11 13:39:31.597235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 592/1163] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:31 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:31.624374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:31.624995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:31.626962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:31.632881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:31.633370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:31.633811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:31.634505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:31.634962 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:31.635703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:31.776228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:31.784732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-6c2b85d5-0aa3-4660-87d8-1ad21c04d3ac tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.164261 Oct 11 13:39:31.785312 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 572/1164] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:31 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:32.541649 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:32.542423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:32.549179 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:32.549621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:32.550075 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:32.550746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:32.551191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:32.551605 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:32.611618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-80ea1df2-8948-4623-99cd-e780a9dfd691 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a55109700>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:32.667871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-80ea1df2-8948-4623-99cd-e780a9dfd691 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 352 microversion: 2.1 time: 0.060468 Oct 11 13:39:32.668578 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 573/1165] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:32 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:32.694439 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:32.702337 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-282c0028-c99b-4035-919d-b58a36244d20 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.165934 Oct 11 13:39:32.702917 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 593/1166] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:32 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:32.808387 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:32.808911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:32.815506 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:32.815998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:32.816458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:32.817167 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:32.817622 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:32.818052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:32.952775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:32.963993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d0edb8f0-1d71-44e2-8612-2c585a3db1c4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.159997 Oct 11 13:39:32.964612 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 574/1167] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:32 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:33.681433 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-2d78a165-c80e-4ad1-8ce3-30ae16e1b80c tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a551a29d0>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.727518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.728101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:33.736083 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:33.736592 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-2d78a165-c80e-4ad1-8ce3-30ae16e1b80c tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 353 microversion: 2.1 time: 0.059049 Oct 11 13:39:33.736987 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:33.737608 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:33.738748 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:33.739261 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:33.739852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:33.745491 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 594/1168] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:33 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:33.750460 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d33a2b12-e16c-4c26-b021-cdc2ab6a704c tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a5523b040>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.804021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d33a2b12-e16c-4c26-b021-cdc2ab6a704c tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 353 microversion: 2.1 time: 0.057237 Oct 11 13:39:33.804684 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 595/1169] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:33 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:33.823866 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ead3a6f2-5878-4fd3-9254-d10d8f63fbc3 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a5523b310>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.895356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ead3a6f2-5878-4fd3-9254-d10d8f63fbc3 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 202 len: 0 microversion: 2.1 time: 0.075162 Oct 11 13:39:33.896941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 596/1170] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 11 13:39:33 2022] DELETE /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 13:39:33.905341 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-102a62b3-49ee-445a-8c2c-0460aeb673ce tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a551a2790>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.913889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:33.923211 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-4c2b7245-ea64-4fae-9881-04d3bb14e48c tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.200698 Oct 11 13:39:33.924012 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 575/1171] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:33 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:33.967271 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-102a62b3-49ee-445a-8c2c-0460aeb673ce tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 200 len: 352 microversion: 2.1 time: 0.065759 Oct 11 13:39:33.967848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 597/1172] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:33 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 13:39:33.986995 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:33.987624 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:33.994038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:33.994525 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:33.994968 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:33.995738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:33.996257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:33.996690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:34.015308 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:34.140094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:34.148697 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8ad7f546-d915-4990-bec4-3e4db4f20488 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.165563 Oct 11 13:39:34.149366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 576/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:33 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:34.436740 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fd6149-adef-4c98-87b0-2744d039d0cb", "name": "network-vif-plugged", "status": "completed", "tag": "7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:34.443153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:34.450495 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:34.451050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:34.451549 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:34.464329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] Creating event network-vif-plugged:7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab for instance 39fd6149-adef-4c98-87b0-2744d039d0cb on hv-cinder-85061 Oct 11 13:39:34.469506 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-f20d3ff0-1cce-4f3b-885a-710199492ac5 req-17226b8e-b9e0-4444-aa0b-185653fb9bc6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037369 Oct 11 13:39:34.470297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 598/1174] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:34.951374 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:34.951992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:34.958716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:34.959206 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:34.959647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:34.963533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:34.963533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:34.963533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:34.982810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6140e10c-0ab5-4865-a58c-481b5e8a01f7 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Calling method '.version_select at 0x7f7a5523be50>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:35.017548 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-6140e10c-0ab5-4865-a58c-481b5e8a01f7 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] HTTP exception thrown: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6140e10c-0ab5-4865-a58c-481b5e8a01f7 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Request method failure captured: Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e HTTP/1.1 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXIRF6MvVZdNXcIAT3hjq8qw0iARXdqpjrW6faA8-l3n-_wti8wPvULZC5p2FIyR0qqCYeje4kJQ19oEqXpQWDm4mZH8THcAqwE20eRSlj4w7swg8iNYbZURk9FstSBPs2g5Q_vzLz6V14W9bk9XMv2YkJMEh0aMV17U7tkY9Nq9FIk Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 862926e6e5334f37aefe16a66778e5e2 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesGetTestJSON-606886952 Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:35.019851 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/862926e6e5334f37aefe16a66778e5e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_862926e6e5334f37aefe16a66778e5e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/862926e6e5334f37aefe16a66778e5e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/862926e6e5334f37aefe16a66778e5e2"}]}] Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesGetTestJSON-606886952 Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 862926e6e5334f37aefe16a66778e5e2 Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesGetTestJSON-606886952 Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesGetTestJSON-606886952-project Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 43968ba640744091b997fdd15462fc1b Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesGetTestJSON-606886952-project Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '876c98db-a0d0-4a9b-9d15-a764ceec740e'} Oct 11 13:39:35.021586 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. (HTTP 404) (Request-ID: req-61472042-415d-4f47-a0cd-cd722639a97b) Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:35.022578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 13:39:35.024096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 13:39:35.025568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6140e10c-0ab5-4865-a58c-481b5e8a01f7 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] Returning 404 to user: Volume 876c98db-a0d0-4a9b-9d15-a764ceec740e could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6140e10c-0ab5-4865-a58c-481b5e8a01f7 tempest-VolumesGetTestJSON-606886952 tempest-VolumesGetTestJSON-606886952-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e" status: 404 len: 109 microversion: 2.1 time: 0.043307 Oct 11 13:39:35.027060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 599/1175] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 11 13:39:34 2022] GET /compute/v2.1/os-volumes/876c98db-a0d0-4a9b-9d15-a764ceec740e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:39:35.112036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:35.120035 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-038fb73d-3bb0-4bcc-92e0-dc9a2561469f tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.173088 Oct 11 13:39:35.120633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 577/1176] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:34 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:35.173234 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:35.174137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:35.182750 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:35.183424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:35.183848 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:35.184859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:35.185340 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:35.185810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:35.324411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:35.332401 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b3a7af6f-817a-402a-873f-57c755486f97 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1265 microversion: 2.1 time: 0.163609 Oct 11 13:39:35.332969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 600/1177] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:35 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:36.144032 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:36.144805 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:36.151541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.152031 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.152467 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.153371 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.154001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.154693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.332852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:36.342941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-9e707833-c012-48f1-9a22-2cc89d1c3086 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.204050 Oct 11 13:39:36.344850 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 578/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:36 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:36.355748 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:36.356441 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:36.364797 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.365536 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.366176 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.367095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.367753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.368418 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.531020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:36.541150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-536ec5d1-0775-45b4-a259-e49b679564bd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1452 microversion: 2.1 time: 0.190045 Oct 11 13:39:36.557021 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 601/1179] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:36 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:36.565182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:36.566147 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:36.582260 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.583170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.583618 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.584253 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:36.585133 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:36.585758 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:36.795553 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:36.804569 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e8dc4513-2821-438e-b1bf-cf9197cb1291 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1452 microversion: 2.1 time: 0.243380 Oct 11 13:39:36.805153 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 579/1180] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:36 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1452 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:37.368789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:37.370061 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:37.378803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:37.379350 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:37.380792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:37.381597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:37.382049 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:37.382511 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:37.559888 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:37.563547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=100 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:37.571756 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-46bb6903-1c7b-49c0-afc7-90d2aac33d65 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.207240 Oct 11 13:39:37.577225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 602/1181] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:37 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:38.599154 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:38.600859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:38.610248 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:38.611250 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:38.612169 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:38.613846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:38.615037 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:38.615916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:38.824265 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:38.835907 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "name": "network-vif-plugged", "status": "completed", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:38.852342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:38.854030 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-eb4a5075-d620-4b45-9346-501966cd14ec tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.258769 Oct 11 13:39:38.854505 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:38.855027 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:38.856991 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 603/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:38 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:38.878689 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] Creating event network-vif-plugged:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:39:38.886179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-1062dac5-c615-4e66-bcfa-21fb8a764977 req-77bf61f3-33bc-45ae-886c-5e6ef7af7059 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365949 Oct 11 13:39:38.887301 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 580/1183] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:39.331841 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fd6149-adef-4c98-87b0-2744d039d0cb", "tag": "7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:39.341609 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:39.342654 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:39.343581 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:39.355653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] Creating event network-changed:7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab for instance 39fd6149-adef-4c98-87b0-2744d039d0cb on hv-cinder-85061 Oct 11 13:39:39.361109 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-35afcd8c-cd78-4333-b1cc-75ae335ea674 req-641d905e-791b-402e-a617-514dd316e98f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032930 Oct 11 13:39:39.362321 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 604/1184] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:39.861284 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-548132333", "imageRef": "3681df74-8fb6-4ead-bd82-da37f3110eba", "flavorRef": "452"}} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:39.880453 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:39.881152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:39.890396 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:39.892175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:39.892803 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:39.893636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:39.894249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:39.894986 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:39.925491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.network.neutron [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] validate_networks() for None {{(pid=118881) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:39:40.497258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:40.508028 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b4ee752a-1e9b-4c67-bca4-491c826fe48a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1572 microversion: 2.1 time: 0.632243 Oct 11 13:39:40.509381 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 605/1185] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:39 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1572 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:40.572361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Flavor limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:39:40.575202 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Image limits 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:39:40.575743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Flavor pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:39:40.576149 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Image pref 0:0:0 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:39:40.576564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.virt.hardware [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118881) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:39:40.586173 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:40.586659 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:40.587096 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:40.587821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:40.588370 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:40.588806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:40.606310 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Getting quotas for project 67d45f22783f474184a77f566663054e. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:39:40.610516 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.quota [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Getting quotas for user f37f54ef73544963af83a4446f66c9bf and project 67d45f22783f474184a77f566663054e. Resources: {'instances', 'ram', 'cores'} {{(pid=118881) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:39:40.621954 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Going to run 1 instances... {{(pid=118881) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:39:40.624394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3681df74-8fb6-4ead-bd82-da37f3110eba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118881) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:39:40.675036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bb253f8e-64a3-4393-b9b9-4588767f5ca7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817668 Oct 11 13:39:40.675778 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 581/1186] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:39:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:39:40.687650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c20105e8-aca7-48e3-8d54-b0bd36d6694f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:40.688472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c20105e8-aca7-48e3-8d54-b0bd36d6694f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:40.744296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c20105e8-aca7-48e3-8d54-b0bd36d6694f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:40.752206 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c20105e8-aca7-48e3-8d54-b0bd36d6694f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1214 microversion: 2.1 time: 0.068857 Oct 11 13:39:40.753027 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 606/1187] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:40 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 13:39:41.531857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:41.532496 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:41.539792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:41.540397 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:41.540838 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:41.541632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:41.542089 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:41.542554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:41.678117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:41.686882 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c912c802-3a6a-4e4b-91e8-7bdbc1514e31 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1559 microversion: 2.1 time: 0.159321 Oct 11 13:39:41.687643 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 582/1188] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:41 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:41.779728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:41.780516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:41.788881 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:41.789582 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:41.790193 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:41.791306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:41.792503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:41.793071 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:41.870029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:41.878824 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ff312edf-adab-449f-a37d-19ffa52c3d8a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1274 microversion: 2.1 time: 0.106509 Oct 11 13:39:41.879417 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 607/1189] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:41 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:42.905632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:42.906806 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:42.922228 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:42.922997 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:42.923699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:42.924688 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:42.925470 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:42.926182 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:43.073495 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:43.081716 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-1282ea6f-0026-43fd-9fa6-112d70ad44ba tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.179822 Oct 11 13:39:43.082540 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 583/1190] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:42 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:43.436903 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0a2c763-6327-4c3b-aace-4230c479ffe1", "tag": "ef31a4d9-f5f1-4cf2-a317-bc07c697ea05"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:43.451088 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:43.452003 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:43.452476 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:43.464760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] Creating event network-changed:ef31a4d9-f5f1-4cf2-a317-bc07c697ea05 for instance e0a2c763-6327-4c3b-aace-4230c479ffe1 on hv-cinder-85061 Oct 11 13:39:43.469944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-040cb9aa-a1d7-41ba-b3bd-7cb5751079ac req-c07f6606-38fb-4ea2-bcfc-ee2267f7b460 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Oct 11 13:39:43.470752 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 608/1191] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:44.104929 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:44.105621 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:44.112619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:44.113123 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:44.113545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:44.114315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:44.114895 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:44.115481 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:44.261328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:44.269158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ef3d16ad-a5a5-4022-bc31-41172c0aaa9f tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.168376 Oct 11 13:39:44.270001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 584/1192] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:44 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:45.293749 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:45.294481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:45.300715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:45.301204 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:45.301652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:45.302357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:45.302816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:45.303237 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:45.461560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:45.470616 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-58ada618-643c-47fa-b246-4bb52033e944 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.181600 Oct 11 13:39:45.471497 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 609/1193] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:45 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:46.493759 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:46.494581 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:46.501280 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:46.501766 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:46.502201 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:46.502892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:46.503342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:46.503765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:46.651239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:46.659414 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-44760107-5590-4ccb-a801-43200a45b6a3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.169926 Oct 11 13:39:46.660001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 585/1194] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:46 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:47.686810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:47.687781 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:47.698858 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:47.699658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:47.700409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:47.701118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:47.701568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:47.701997 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:47.836708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:47.848208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-42ab1083-2b4e-44ea-89ba-baafa5b8faa7 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.167885 Oct 11 13:39:47.848969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 610/1195] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:47 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:48.871341 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:48.871953 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:48.878985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:48.879478 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:48.879921 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:48.880653 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:48.881110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:48.881542 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:49.025601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:49.033521 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-da2ce680-5639-4c13-8cdf-dae892a1aa5c tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.166236 Oct 11 13:39:49.034118 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 586/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:48 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:50.056959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:50.057565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:50.064672 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:50.065175 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:50.065639 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:50.066360 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:50.066846 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:50.067301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:50.203712 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:50.214842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-069d61c7-fbb4-4f5a-ae30-bc73fbe649e6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.161763 Oct 11 13:39:50.215569 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 611/1197] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:50 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:50.542985 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a2c763-6327-4c3b-aace-4230c479ffe1", "name": "network-vif-plugged", "status": "completed", "tag": "ef31a4d9-f5f1-4cf2-a317-bc07c697ea05"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:50.553330 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:50.553817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:50.554207 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:50.565942 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] Creating event network-vif-plugged:ef31a4d9-f5f1-4cf2-a317-bc07c697ea05 for instance e0a2c763-6327-4c3b-aace-4230c479ffe1 on hv-cinder-85061 Oct 11 13:39:50.571101 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-1f85a53d-66d9-424d-a651-a3a4dff2fd80 req-ba2a24f5-753f-4cd7-9ca3-49346a00e1c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Oct 11 13:39:50.571953 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 587/1198] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:51.237376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:51.238161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:51.240275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:51.246657 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:51.247186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:51.247751 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:51.248693 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:51.249224 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:51.249706 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:51.380397 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:51.388950 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-ff9ca9f3-4712-4d1c-8eb5-e2281e1da02a tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.155324 Oct 11 13:39:51.389560 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 612/1199] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:51 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:52.408365 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:52.409225 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=6 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:39:52.414096 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:52.414881 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:52.422475 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:52.422969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:52.423415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:52.424088 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:52.424753 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:52.425215 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:52.569735 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:52.578024 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7d345f3e-7b91-486e-828a-c9ebb757f9f3 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1314 microversion: 2.1 time: 0.170621 Oct 11 13:39:52.578638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 588/1200] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:52 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:53.601891 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:53.602504 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:53.608889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.609402 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.609814 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:53.610505 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.611070 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.611512 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:53.744638 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:53.752956 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4e7afca7-fbaf-46d9-83d7-6f00a2505d04 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1464 microversion: 2.1 time: 0.155082 Oct 11 13:39:53.766208 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 613/1201] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:53 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:53.802772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:53.803306 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:53.809719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.810214 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.810635 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:53.811322 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.811842 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.812195 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:53.837747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:39:53.917626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ba0dc604-90f7-46bc-b6eb-81111f33eea6 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "DELETE /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 204 len: 0 microversion: 2.1 time: 0.118282 Oct 11 13:39:53.918498 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 589/1202] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:39:53 2022] DELETE /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:39:53.927483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:53.928235 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:53.934458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.934941 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.935425 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:53.936143 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:53.936620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:53.937123 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:54.068534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:54.080167 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-42436ced-f72c-4e5a-8576-57022c076692 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1470 microversion: 2.1 time: 0.156808 Oct 11 13:39:54.081053 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 614/1203] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:53 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:55.109431 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:55.110291 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:55.117136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:55.117625 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:55.118062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:55.118762 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:55.119227 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:55.119823 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:55.257978 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:55.269949 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-f3d84117-6be3-48c3-9051-f23d56c85ea8 tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1470 microversion: 2.1 time: 0.165159 Oct 11 13:39:55.270619 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 590/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:55 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:56.220093 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0a2c763-6327-4c3b-aace-4230c479ffe1", "name": "network-vif-deleted", "tag": "ef31a4d9-f5f1-4cf2-a317-bc07c697ea05"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:39:56.231260 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:56.231777 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:56.232239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:56.252763 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] Creating event network-vif-deleted:ef31a4d9-f5f1-4cf2-a317-bc07c697ea05 for instance e0a2c763-6327-4c3b-aace-4230c479ffe1 on hv-cinder-85061 Oct 11 13:39:56.258472 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-83899cae-c85f-4a4a-a9cd-a85e7ae251de req-dcf94023-56a1-4731-8b69-c97f91055afe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042740 Oct 11 13:39:56.259051 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 615/1205] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:39:56.296424 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:56.297889 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:56.305165 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:56.305738 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:56.306239 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:56.307036 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:56.307795 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:56.308410 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:56.347947 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:56.348572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:56.349473 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:56.350338 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.objects.instance [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lazy-loading 'fault' on Instance uuid e0a2c763-6327-4c3b-aace-4230c479ffe1 {{(pid=118881) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 13:39:56.394769 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f37f54ef73544963af83a4446f66c9bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d45f22783f474184a77f566663054e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:39:56.402767 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-8f1b5e2d-7136-4824-b3fa-93845af620bb tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 200 len: 1304 microversion: 2.1 time: 0.111680 Oct 11 13:39:56.403346 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 591/1206] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:56 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:39:57.435856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:39:57.437245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] [instance: e0a2c763-6327-4c3b-aace-4230c479ffe1] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:39:57.445009 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:57.445483 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:57.445945 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:57.446652 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:39:57.447082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:39:57.447531 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:39:57.461618 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] HTTP exception thrown: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Request method failure captured: Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 HTTP/1.1 Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXIZ4r1j4g4Q_tgHw7Ozq07BKG666zsw0ZztQxHrW4jbzLLvSpjdDTkRLf0g3QCOMZs13uhgqLRFvNqvr8lqMgfwPUERWJti9W79Bwypal96YXDnUcTeH1oc_OvLTA-CoAZ6ztcvKalUwc4REzKX95njI7P8OZUT41ywdt1rncy4Kak Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 67d45f22783f474184a77f566663054e Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-VolumesNegativeTest-1463921606 Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:39:57.463280 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/67d45f22783f474184a77f566663054e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_67d45f22783f474184a77f566663054e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67d45f22783f474184a77f566663054e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/67d45f22783f474184a77f566663054e"}]}] Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-VolumesNegativeTest-1463921606 Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 67d45f22783f474184a77f566663054e Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-VolumesNegativeTest-1463921606 Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-VolumesNegativeTest-1463921606-project Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: f37f54ef73544963af83a4446f66c9bf Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-VolumesNegativeTest-1463921606-project Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. Oct 11 13:39:57.465081 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'e0a2c763-6327-4c3b-aace-4230c479ffe1'} Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:39:57.466137 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. Oct 11 13:39:57.467680 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:39:57.469126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] Returning 404 to user: Instance e0a2c763-6327-4c3b-aace-4230c479ffe1 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:39:57.469126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f361b144-d3c7-4a8b-9f51-d0b00ccc4dbd tempest-VolumesNegativeTest-1463921606 tempest-VolumesNegativeTest-1463921606-project] 10.222.0.15 "GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1" status: 404 len: 111 microversion: 2.1 time: 0.036791 Oct 11 13:39:57.469126 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 616/1207] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:39:57 2022] GET /compute/v2.1/servers/e0a2c763-6327-4c3b-aace-4230c479ffe1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:41:33.694307 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:33.695481 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=37 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:33.696287 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:33.696742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=62 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:41:33.698238 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 13:41:33.702017 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:41:33.707329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:33.707970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:41:33.713537 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:33.714020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:33.714420 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:33.719046 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:33.719670 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:33.720218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:33.721019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:33.721559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:33.722057 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:33.727200 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] Creating event network-changed:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:41:33.732563 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-c997bf4d-f2fe-40d4-bf0b-0c0c843a532d req-36c7683d-eace-47d4-8fd5-476c6718ec6d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038678 Oct 11 13:41:33.733427 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 617/1208] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:41:33.752885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:41:33.834073 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-45ff899b-42b3-4fef-9052-555799cd88dc tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "DELETE /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 204 len: 0 microversion: 2.1 time: 0.142010 Oct 11 13:41:33.835170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 592/1209] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:41:33 2022] DELETE /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:41:33.847795 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:33.848551 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:41:33.855166 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:33.855650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:33.856304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:33.857188 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:33.857642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:33.858064 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:34.004668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:41:34.014424 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-36389f57-b16e-465f-bda0-bc7950d5afbe tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.173283 Oct 11 13:41:34.015033 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 618/1210] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:41:33 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:41:35.039393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:35.040100 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:41:35.047135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:35.047718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:35.048158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:35.048897 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:35.049328 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:35.049747 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:35.184537 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:41:35.192458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-3e9435d3-e7f8-4184-a881-e3f62ce8a394 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1565 microversion: 2.1 time: 0.157404 Oct 11 13:41:35.193033 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 593/1211] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:41:35 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:41:36.026304 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58398545-4e73-43e1-8691-2bd81d53c2eb", "name": "network-vif-deleted", "tag": "1fe7689b-6f1d-4afc-a4a5-bef545707f5d"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:41:36.036405 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:36.036882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:36.037315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:36.049258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] Creating event network-vif-deleted:1fe7689b-6f1d-4afc-a4a5-bef545707f5d for instance 58398545-4e73-43e1-8691-2bd81d53c2eb on hv-cinder-85061 Oct 11 13:41:36.054534 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-206af952-690f-4fe2-9a01-c34f02ed7deb req-01a5f828-fc29-4fd3-8a69-56e435317fb0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Oct 11 13:41:36.055144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 619/1212] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:41:36.219099 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:36.219952 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:41:36.226654 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:36.227135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:36.227562 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:36.228295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:36.228745 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:36.229162 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:36.290872 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983c742ffffe4a82a722eb1b1c23f971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81282f5bd6b34d90afaba281d5bbc16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:41:36.299429 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e38bf935-1663-4d78-9be8-eb7aed9b66a0 tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 200 len: 1219 microversion: 2.1 time: 0.087000 Oct 11 13:41:36.312396 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 594/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:41:36 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:41:37.328765 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:37.329690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] [instance: 58398545-4e73-43e1-8691-2bd81d53c2eb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:41:37.337393 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:37.337919 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:37.338408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:37.339184 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:41:37.339692 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:41:37.340150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:41:37.356869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] HTTP exception thrown: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Request method failure captured: Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb HTTP/1.1 Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXE3hZvN83_DOFfzga9VdPNLCwY_QlAp-auM2EjlPGt1Pn8qPCfY9JU3aaJzAFfWBN5d1zrpkS5QVwNDK4Y8fHjRe-kS9L0v6TK_QAkb56YsetyGSimXfwfOnbiGzOM1d0Em_PK-zexQtHZCimP4uIOd6iLBXOvEV2BW_-tzfZp1x8U Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 81282f5bd6b34d90afaba281d5bbc16b Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-TestShelveInstance-982109325 Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:41:37.358665 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/81282f5bd6b34d90afaba281d5bbc16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_81282f5bd6b34d90afaba281d5bbc16b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81282f5bd6b34d90afaba281d5bbc16b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/81282f5bd6b34d90afaba281d5bbc16b"}]}] Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-TestShelveInstance-982109325 Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 81282f5bd6b34d90afaba281d5bbc16b Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-TestShelveInstance-982109325 Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-TestShelveInstance-982109325-project Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 983c742ffffe4a82a722eb1b1c23f971 Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-TestShelveInstance-982109325-project Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. Oct 11 13:41:37.360808 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '58398545-4e73-43e1-8691-2bd81d53c2eb'} Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:41:37.361896 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. Oct 11 13:41:37.363568 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:41:37.365099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Returning 404 to user: Instance 58398545-4e73-43e1-8691-2bd81d53c2eb could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:41:37.365099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b477a5a1-e18c-463a-8f5f-137aa0d7d53a tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb" status: 404 len: 111 microversion: 2.1 time: 0.039299 Oct 11 13:41:37.365099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 620/1214] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:41:37 2022] GET /compute/v2.1/servers/58398545-4e73-43e1-8691-2bd81d53c2eb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:41:37.533781 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a88146ac-5e48-4964-944e-1bc6752f151e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] Calling method '.version_select at 0x7f7a552f3af0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:41:37.562461 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a88146ac-5e48-4964-944e-1bc6752f151e tempest-TestShelveInstance-982109325 tempest-TestShelveInstance-982109325-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169379414" status: 202 len: 0 microversion: 2.1 time: 0.032644 Oct 11 13:41:37.563150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 595/1215] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 11 13:41:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169379414 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 13:42:18.895883 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=8 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:18.897144 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=12 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:18.903871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:18.904747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:18.915526 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.916263 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.916718 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:18.917382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:18.917849 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:18.918267 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:18.945239 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Going to try to terminate instance {{(pid=118880) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:42:19.022244 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d3ee16c1-3fac-4d6a-96e4-3ff7a8575b22 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "DELETE /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 204 len: 0 microversion: 2.1 time: 0.128108 Oct 11 13:42:19.023149 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 621/1216] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:42:18 2022] DELETE /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:42:19.029245 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:19.030302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:19.034497 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:19.035110 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:19.046455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:19.046930 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:19.047362 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:19.048050 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:19.048522 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:19.048941 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:19.406067 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:19.414155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7d207908-d26a-4501-8391-39766496e91d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1576 microversion: 2.1 time: 0.386492 Oct 11 13:42:19.414719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 596/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:19 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1576 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:20.439060 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:20.439707 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:20.446767 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:20.447313 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:20.447753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:20.448473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:20.448924 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:20.449344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:20.638150 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:20.646603 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1439b8b1-6d4a-4291-bc30-592e928e87e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1576 microversion: 2.1 time: 0.211830 Oct 11 13:42:20.647151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 622/1218] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:20 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:21.487876 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fd6149-adef-4c98-87b0-2744d039d0cb", "name": "network-vif-deleted", "tag": "7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:21.499171 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:21.499788 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:21.500518 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.513743 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] Creating event network-vif-deleted:7ed96ea4-3ee2-4c2f-b3b2-26a1607340ab for instance 39fd6149-adef-4c98-87b0-2744d039d0cb on hv-cinder-85061 Oct 11 13:42:21.521117 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-45d4c293-5645-46b8-b73f-3abf17e46c1a req-0b391983-a722-46e8-9968-9a2355bc5e48 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035946 Oct 11 13:42:21.521774 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 597/1219] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:21.669610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:21.670275 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:21.680107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:21.682376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:21.682837 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.683562 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:21.684024 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:21.684465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:21.747388 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:21.755222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b8617b9f-d29f-4512-8bb2-bf172cc074c3 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 200 len: 1224 microversion: 2.1 time: 0.089607 Oct 11 13:42:21.755831 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 623/1220] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:21 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:22.783937 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:22.785115 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:22.793876 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:22.794358 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:22.794799 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:22.795493 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:22.795986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:22.796445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:22.809779 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] HTTP exception thrown: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Request method failure captured: Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb HTTP/1.1 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXHfLtLqGL8GFsyIPUl5dlOLcVd_piCMFfAigWOCt-dC-eMH8FwxFJBYVwPP-Mg2F9_ZX2Coo1bP9Rdc2wW2sAZqiP0H28_1hQacC0pp2pnd2HLaDfpZPLhlCuLXokasXXvEpkIsMBTd4YY9Ur7G1jRQs_Orhw01IsxMz_UDZ8wNXaI Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:42:22.811393 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_340df5a9e41940d7b010168feb108bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}] Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 76d8100e29a24533a014b8d073e45ca5 Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:42:22.813231 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '39fd6149-adef-4c98-87b0-2744d039d0cb'} Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:42:22.814463 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:42:22.816188 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:42:22.817817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Returning 404 to user: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:42:22.817817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7d5d21af-17ce-4a7a-b5de-0e81d346294e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 404 len: 111 microversion: 2.1 time: 0.036773 Oct 11 13:42:22.817817 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 598/1221] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:22 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:42:22.923621 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-179246944", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620164794", "security_groups": [{"name": "tempest-secgroup-smoke-1462030698"}], "block_device_mapping_v2": [{"uuid": "70569b1b-5b67-49b8-a6e0-c3681aa95840", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "627df37d-77c7-4ff1-8964-bb0e3dd0d0a6"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:23.046690 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] validate_networks() for [('627df37d-77c7-4ff1-8964-bb0e3dd0d0a6', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:42:23.430944 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:42:23.431503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:42:23.432245 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:42:23.432789 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:42:23.433351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:42:23.447474 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:23.447972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:23.448436 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:23.449151 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:23.449598 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:23.450014 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:23.466937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:42:23.471130 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for user 76d8100e29a24533a014b8d073e45ca5 and project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:42:23.527796 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:42:23.529969 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70569b1b-5b67-49b8-a6e0-c3681aa95840',volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:42:23.665252 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [33a0afe5-4269-43b3-9681-430a040777ba] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 13:42:24.678627 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [33a0afe5-4269-43b3-9681-430a040777ba] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53736. Oct 11 13:42:24.684092 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-d9f6a5bd-3f13-47d8-95b1-974c1d0ac11d tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.766619 Oct 11 13:42:24.684842 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 624/1222] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:42:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:42:24.696268 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ec87a598-d22f-41d6-b1b1-51f2666abb55 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:24.696885 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ec87a598-d22f-41d6-b1b1-51f2666abb55 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:24.751651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ec87a598-d22f-41d6-b1b1-51f2666abb55 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:24.758751 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ec87a598-d22f-41d6-b1b1-51f2666abb55 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1093 microversion: 2.1 time: 0.066486 Oct 11 13:42:24.759350 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 599/1223] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:24 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:25.782444 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:25.783113 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:25.789867 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:25.790356 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:25.790936 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:25.791900 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:25.792383 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:25.792816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:25.861670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:25.869541 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-a5f8c5ad-25d1-4930-bda7-80e1133a3fbd tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1209 microversion: 2.1 time: 0.091487 Oct 11 13:42:25.870120 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 625/1224] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:25 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:26.893179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:26.893780 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:26.901325 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.901871 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.902377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:26.903135 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:26.903641 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:26.904302 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:27.036548 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:27.045002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b5504b04-74cf-40a2-92f9-a615e606ee5b tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.155799 Oct 11 13:42:27.045901 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 600/1225] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:26 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:27.059700 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b671a8-44f0-4ed2-99b8-c53b80cfd297", "tag": "6dcf2157-77e9-43d8-9666-5d0c269eb5f5"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:27.071920 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:27.072547 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:27.073480 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:27.096607 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] Creating event network-changed:6dcf2157-77e9-43d8-9666-5d0c269eb5f5 for instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 on hv-cinder-85061 Oct 11 13:42:27.101770 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-cf826e66-0a70-4c84-8de3-55ebe85a534a req-1a342d67-e887-41cf-8f72-6e09ce062ab8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047286 Oct 11 13:42:27.102465 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 626/1226] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:28.073401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:28.074131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:28.082947 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:28.083599 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:28.084158 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:28.085069 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:28.085633 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:28.086170 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:28.225458 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:28.233699 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c37fd6ea-071e-4b84-bd99-d14c59039d90 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.166817 Oct 11 13:42:28.234255 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 601/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:28 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:29.264380 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:29.265496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:29.275882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.276404 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.276840 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:29.277533 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:29.277981 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:29.278406 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:29.420411 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:29.431784 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-957fbe7f-2fda-4018-b653-b8ffa8ee03df tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.176126 Oct 11 13:42:29.432630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 627/1228] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:29 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:30.459307 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:30.460560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:30.468822 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:30.469309 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:30.469752 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:30.470459 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:30.470939 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:30.471366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:30.606969 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:30.618812 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-7f4da4c3-bdca-4832-848b-65d0051672e4 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.166142 Oct 11 13:42:30.619361 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 602/1229] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:30 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:31.646301 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:31.647358 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:31.658309 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.659100 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.659816 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.661018 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:31.661746 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:31.662498 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:31.802359 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:31.814477 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-b2db1a57-150b-407c-a294-eb0c68958862 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.174393 Oct 11 13:42:31.815258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 628/1230] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:31 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:32.838993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:32.839650 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:32.847447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:32.847926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:32.848511 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:32.849299 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:32.849824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:32.850334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:32.991418 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:33.000001 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ebc6510d-75b8-4e11-aaad-15273a250d99 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.165487 Oct 11 13:42:33.000604 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 603/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:32 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:34.027225 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:34.027898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:34.031601 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:34.032454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:34.040050 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.040617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.041117 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.042155 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:34.042615 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:34.043032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:34.190668 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:34.198937 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-cf8278b2-c5bb-4e90-b67b-0f1c7673322e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.178033 Oct 11 13:42:34.199501 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 629/1232] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:34 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:35.226494 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:35.227446 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:35.231257 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:42:35.237249 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:35.237734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:35.238166 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:35.238854 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:35.239300 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:35.239721 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:35.395205 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:35.403062 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-eaa1a6ca-9151-472c-8842-52720d5347ec tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.183150 Oct 11 13:42:35.403667 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 604/1233] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:35 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:36.429614 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:36.430648 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:36.439228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.439708 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.440152 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.440855 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:36.441297 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:36.441715 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:36.581164 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:36.589145 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-614c9fa1-4ef9-4a5d-9d40-aec5de709ba7 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.166158 Oct 11 13:42:36.589738 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 630/1234] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:36 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:37.612680 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:37.613234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:37.620329 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.620818 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.621266 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.621970 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:37.622423 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:37.622851 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:37.757816 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:37.766415 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-22a7c330-5e55-47e1-8b64-1320d89996d9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.157821 Oct 11 13:42:37.766999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 605/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:37 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:38.793182 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:38.794230 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:38.805127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:38.805911 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:38.806655 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:38.807754 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:38.808530 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:38.809228 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:38.940932 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:38.953026 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-f1470134-fa3e-4cff-bf74-32ad3b9711db tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.165948 Oct 11 13:42:38.953918 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 631/1236] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:38 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:39.283353 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b671a8-44f0-4ed2-99b8-c53b80cfd297", "name": "network-vif-plugged", "status": "completed", "tag": "6dcf2157-77e9-43d8-9666-5d0c269eb5f5"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:39.295038 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.295552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.296097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:39.307804 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] Creating event network-vif-plugged:6dcf2157-77e9-43d8-9666-5d0c269eb5f5 for instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 on hv-cinder-85061 Oct 11 13:42:39.313293 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-4f6d867b-50be-4919-bf05-1fcb9a2aadf3 req-9b508186-4e63-4650-a3f2-1ebffa47df55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Oct 11 13:42:39.313908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 606/1237] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:42:39.985289 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:39.986269 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:39.997272 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:39.998082 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:39.998886 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.000153 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:40.000934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:40.001641 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:40.154136 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:40.162653 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4d1c5d4b-8135-4741-8ff4-285227c5ed03 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1265 microversion: 2.1 time: 0.184000 Oct 11 13:42:40.163229 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 632/1238] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:39 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:41.191008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.192174 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:41.202852 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.203719 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.204144 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.204862 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.205315 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.205734 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.342982 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:41.355210 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-a979c8ec-b986-45d7-9a71-5624982b1c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1452 microversion: 2.1 time: 0.172041 Oct 11 13:42:41.355993 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 607/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:41.377994 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:42:41.378597 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:42:41.385251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.385728 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.386163 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.387231 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:41.387682 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:41.388103 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:41.519863 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:42:41.528183 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-072b883b-4e57-47a5-aab0-3d3bb52f5c85 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1452 microversion: 2.1 time: 0.154284 Oct 11 13:42:41.528762 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 633/1240] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:42:41 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:42:43.516455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b671a8-44f0-4ed2-99b8-c53b80cfd297", "tag": "6dcf2157-77e9-43d8-9666-5d0c269eb5f5"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:42:43.526219 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:42:43.526635 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:42:43.527070 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:42:43.538560 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] Creating event network-changed:6dcf2157-77e9-43d8-9666-5d0c269eb5f5 for instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 on hv-cinder-85061 Oct 11 13:42:43.543856 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-ca9fe819-b379-4aa8-bf49-8bc677102cdd req-671d74bd-57e0-4aad-ae56-6881fc60e994 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090928 Oct 11 13:42:43.544585 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 608/1241] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:42.559317 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:42.560096 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:42.561180 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:44:42.561386 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Tue Oct 11 13:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 11 13:44:42.562733 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 13:44:42.562928 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Tue Oct 11 13:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 11 13:44:42.567703 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-800004757", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620164794", "security_groups": [{"name": "tempest-secgroup-smoke-1462030698"}], "block_device_mapping_v2": [{"uuid": "0c4e307c-d13d-4d55-80bc-fce6d6932458", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "627df37d-77c7-4ff1-8964-bb0e3dd0d0a6"}]}} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:42.692872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.network.neutron [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] validate_networks() for [('627df37d-77c7-4ff1-8964-bb0e3dd0d0a6', None, None, None, None, None)] {{(pid=118880) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 13:44:43.122283 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 13:44:43.122697 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image limits 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 13:44:43.123157 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Flavor pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 13:44:43.123565 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Image pref 0:0:0 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 13:44:43.123967 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.virt.hardware [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 13:44:43.133032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:43.133510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:43.133939 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:43.134650 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:43.135101 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:43.135513 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:43.153078 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 13:44:43.157394 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.quota [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Getting quotas for user 76d8100e29a24533a014b8d073e45ca5 and project 340df5a9e41940d7b010168feb108bd3. Resources: {'instances', 'ram', 'cores'} {{(pid=118880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 13:44:43.216545 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Going to run 1 instances... {{(pid=118880) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 13:44:43.218701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c4e307c-d13d-4d55-80bc-fce6d6932458',volume_size=None,volume_type=None)] {{(pid=118880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 13:44:43.360874 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e5ec9b18-cefa-4622-9b14-19ee7a55b2e1 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803269 Oct 11 13:44:43.361517 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 634/1242] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 11 13:44:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 13:44:43.373305 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a08324a-faa5-454e-afe9-4756e5e85ac7] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 13:44:43.373965 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=28 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:43.375234 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=56 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:43.377630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 13:44:43.377790 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Tue Oct 11 13:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 (ip 10.222.0.15) !!! Oct 11 13:44:43.379772 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 13:44:43.379898 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Tue Oct 11 13:44:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 (ip 10.222.0.15) !!! Oct 11 13:44:43.396572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-2f8c6388-5871-4e1c-b69f-a0c915f68cdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:43.397285 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-2f8c6388-5871-4e1c-b69f-a0c915f68cdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:43.452150 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-2f8c6388-5871-4e1c-b69f-a0c915f68cdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:43.459636 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-2f8c6388-5871-4e1c-b69f-a0c915f68cdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1093 microversion: 2.1 time: 0.089996 Oct 11 13:44:43.460250 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 609/1243] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:43 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1093 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:44.483463 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:44.484161 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:44.493127 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.493732 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.494246 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.495669 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:44.496496 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:44.496930 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:44.560342 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:44.572029 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-9ba8d701-86c6-4d5d-bd6b-f9c77e312cb5 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1199 microversion: 2.1 time: 0.090768 Oct 11 13:44:44.576646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 635/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:44 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:45.592539 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:45.593155 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:45.613851 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.614626 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.615311 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:45.616375 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:45.617016 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:45.617544 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:45.623773 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a08324a-faa5-454e-afe9-4756e5e85ac7] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53898. Oct 11 13:44:45.753126 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:45.761438 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-c838f776-eb26-4ea4-9e87-e773b706122c tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.172842 Oct 11 13:44:45.762434 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 610/1245] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:45 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:46.208889 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef5f133-cfd9-4e94-b2d9-4989a4744189", "tag": "7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:46.222499 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:46.223503 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:46.224343 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.236098 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] Creating event network-changed:7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402 for instance aef5f133-cfd9-4e94-b2d9-4989a4744189 on hv-cinder-85061 Oct 11 13:44:46.242195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-83f10780-178a-494e-bb40-2502701363c4 req-8f609963-cfb3-44ad-ae58-60023894e842 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106249 Oct 11 13:44:46.242804 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 636/1246] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:46.789138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:46.790094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:46.800906 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:46.801693 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:46.802416 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.803542 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:46.804334 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:46.805034 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:46.942366 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:46.950545 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-d953d21e-c4e1-49e1-b6f7-b8098591ed65 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.168010 Oct 11 13:44:46.951131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 611/1247] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:46 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:47.974859 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:47.975525 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:47.982705 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.983186 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.983620 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:47.984351 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:47.984798 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:47.985218 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:48.124902 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:48.132978 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-e7c3b928-74a6-477e-bfdb-7f4af228ec4e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.162884 Oct 11 13:44:48.133516 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 637/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:47 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:49.160632 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:49.161718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:49.172534 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.173377 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.174094 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.175218 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:49.175963 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:49.176715 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:49.312638 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:49.320429 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-93ae58fc-4601-4309-b4a7-bb89ca11a449 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.166398 Oct 11 13:44:49.320999 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 612/1249] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:49 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:50.347695 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:50.348758 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:50.359792 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.360622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.361335 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.362457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:50.363203 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:50.363898 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:50.502934 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:50.510985 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-91e01cad-8ae2-4b08-88a7-251a2aa580a6 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.169825 Oct 11 13:44:50.511552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 638/1250] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:50 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:51.538187 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:51.539198 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:51.547490 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.547980 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.548447 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.549143 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:51.549606 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:51.550044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:51.690848 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:51.698966 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e1bd1fd5-c559-4c7a-8005-29650070b726 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.167234 Oct 11 13:44:51.699546 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 613/1251] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:51 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:52.726419 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:52.727385 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:52.738821 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.739622 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.740408 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.741617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:52.742349 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:52.743056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:52.886288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:52.894747 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-0e14c501-f9da-4844-8b24-21930f014c9a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.174910 Oct 11 13:44:52.895325 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 639/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:52 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:53.918179 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:53.918798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:53.921296 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell0:SELECT=2 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:53.927052 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.927541 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.927981 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:53.928685 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:53.929131 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:53.929550 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:54.068372 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:54.082127 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-53b72773-b8f1-4f1b-904f-f9aae926d385 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.167739 Oct 11 13:44:54.083002 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 614/1253] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:53 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:55.112326 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:55.113305 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:55.116454 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=2 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:55.117514 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell0:SELECT=6 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:44:55.124714 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.125191 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.125625 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.126315 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:55.126760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:55.127172 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:55.261129 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:55.269473 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-4596360d-466d-47e1-94f3-c4557b85959a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.163978 Oct 11 13:44:55.270099 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 640/1254] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:55 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:56.295427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:56.296579 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:56.307649 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.308651 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.309106 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.309798 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:56.310254 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:56.310679 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:56.445570 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:56.454754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-923069f8-0c0f-47d4-8921-0892b1b7a461 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.165509 Oct 11 13:44:56.455710 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 615/1255] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:56 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:57.481646 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:57.482251 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:57.488815 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.489296 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.489721 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.490409 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:57.490882 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:57.491288 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:57.627577 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:57.635664 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-edc65360-7e55-484d-9c12-4b52ca25816a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.159928 Oct 11 13:44:57.636276 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 641/1256] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:57 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:58.099000 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5f133-cfd9-4e94-b2d9-4989a4744189", "name": "network-vif-plugged", "status": "completed", "tag": "7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402"}]} {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:44:58.110226 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.110703 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.111136 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.122824 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.compute.server_external_events [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] Creating event network-vif-plugged:7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402 for instance aef5f133-cfd9-4e94-b2d9-4989a4744189 on hv-cinder-85061 Oct 11 13:44:58.127775 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [req-9234a052-bd76-4b4e-b285-2bcb166bdbbc req-c31edc58-d271-4c64-aabe-3e43c60b9e29 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090787 Oct 11 13:44:58.128401 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 616/1257] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:44:58.663426 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:58.664658 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:58.675578 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.676413 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.677135 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.678270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:58.679023 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:58.679723 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:58.816368 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:44:58.824869 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-351f3878-10ca-4859-9720-1204746763f2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.167956 Oct 11 13:44:58.825446 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 642/1258] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:58 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:44:59.850811 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:44:59.851765 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:44:59.861097 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.861736 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.862313 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:44:59.863230 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:44:59.863834 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:44:59.864444 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:00.002342 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:00.010445 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b8f274d7-2603-4da9-8bb3-600568cd4fdf tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1265 microversion: 2.1 time: 0.165310 Oct 11 13:45:00.011015 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 617/1259] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:44:59 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:01.038074 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:01.039091 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:01.048107 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.048613 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.049025 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.049745 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.050195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.050617 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.190636 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:01.202300 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c2a85259-391a-471c-a761-06a29b4fe1e2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1452 microversion: 2.1 time: 0.170422 Oct 11 13:45:01.203056 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 643/1260] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:01 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:01.229911 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:45:01.230696 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:45:01.237926 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.238412 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.238853 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.239567 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:01.240023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:01.240491 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:01.377317 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:45:01.385768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-e35bbdd4-265c-429b-b61f-c02572e099a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1452 microversion: 2.1 time: 0.159769 Oct 11 13:45:01.386340 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 618/1261] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:45:01 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:45:03.369133 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef5f133-cfd9-4e94-b2d9-4989a4744189", "tag": "7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:45:03.379222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:45:03.380382 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:45:03.381022 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:45:03.393120 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] Creating event network-changed:7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402 for instance aef5f133-cfd9-4e94-b2d9-4989a4744189 on hv-cinder-85061 Oct 11 13:45:03.398303 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-0dbeb529-723b-493d-a852-1f4ad60a4919 req-984d66a4-a4f5-472a-b430-fb87bc9e68a4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032804 Oct 11 13:45:03.398925 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 644/1262] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:06.757384 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR oslo.messaging._drivers.impl_rabbit [-] [45f0f4f2-a826-4121-b462-ab8acf98bbf9] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 13:47:06.758043 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:06.758716 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG dbcounter [-] [118880] Writing DB stats nova_cell1:SELECT=54 {{(pid=118880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:06.759524 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.760908 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.764414 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef5f133-cfd9-4e94-b2d9-4989a4744189", "tag": "7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:06.764730 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_api:SELECT=22 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:06.765427 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG dbcounter [-] [118881] Writing DB stats nova_cell1:SELECT=50 {{(pid=118881) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 13:47:06.773792 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.774275 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.774711 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.775277 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.775422 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.775753 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.775888 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.776217 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.776455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.787395 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] Creating event network-changed:7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402 for instance aef5f133-cfd9-4e94-b2d9-4989a4744189 on hv-cinder-85061 Oct 11 13:47:06.792704 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-44704d3a-805d-4b26-8e1d-ce3d58f5ab0e req-8807b452-a54f-47c3-a0e5-9eef1a75cd9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 Oct 11 13:47:06.793306 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 645/1263] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:06.808303 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:06.892601 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-ecb8af20-9f67-4fb0-8638-fb677299e5a2 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 204 len: 0 microversion: 2.1 time: 0.139202 Oct 11 13:47:06.893533 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 619/1264] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:06 2022] DELETE /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:06.902553 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:06.903249 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:06.909673 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.910165 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.910610 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:06.911312 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:06.911760 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:06.912295 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:07.050469 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:07.058510 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-17b19048-587f-4530-80fc-a53e72b6364e tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1576 microversion: 2.1 time: 0.160191 Oct 11 13:47:07.059093 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 646/1265] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:06 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:08.083243 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:08.084184 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:08.091907 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.092429 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.092859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.093559 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:08.094008 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:08.094430 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:08.225264 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:08.233564 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-bf71c567-4301-4355-8f1a-4be27ca9c539 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1576 microversion: 2.1 time: 0.154499 Oct 11 13:47:08.234076 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 620/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:08 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:09.004020 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef5f133-cfd9-4e94-b2d9-4989a4744189", "name": "network-vif-deleted", "tag": "7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:09.015291 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.015768 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.016236 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.030630 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] Creating event network-vif-deleted:7e5ac4f1-8e6c-40a9-8fce-6e266fa6f402 for instance aef5f133-cfd9-4e94-b2d9-4989a4744189 on hv-cinder-85061 Oct 11 13:47:09.034293 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO oslo.messaging._drivers.impl_rabbit [-] [45f0f4f2-a826-4121-b462-ab8acf98bbf9] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 53996. Oct 11 13:47:09.036001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-9fc24ff9-8afe-4e5b-b9aa-a89b3556fd8e req-38fa2616-b37c-4ad9-a3f9-407855eb31d7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Oct 11 13:47:09.036647 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 647/1267] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:09.259831 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:09.260455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:09.267845 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.268394 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.268836 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.269530 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:09.270196 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:09.270587 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:09.342880 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:09.351998 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-cf55bbe9-e7cb-4376-b53c-69e4e6accc0a tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 200 len: 1224 microversion: 2.1 time: 0.097029 Oct 11 13:47:09.362783 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 621/1268] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:09 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:10.377258 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:10.378001 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: aef5f133-cfd9-4e94-b2d9-4989a4744189] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:10.384970 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.385415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.385845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.386868 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:10.387318 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:10.387735 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:10.401701 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] HTTP exception thrown: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Request method failure captured: Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 HTTP/1.1 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHfLtLqGL8GFsyIPUl5dlOLcVd_piCMFfAigWOCt-dC-eMH8FwxFJBYVwPP-Mg2F9_ZX2Coo1bP9Rdc2wW2sAZqiP0H28_1hQacC0pp2pnd2HLaDfpZPLhlCuLXokasXXvEpkIsMBTd4YY9Ur7G1jRQs_Orhw01IsxMz_UDZ8wNXaI Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:47:10.403311 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_340df5a9e41940d7b010168feb108bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}] Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 76d8100e29a24533a014b8d073e45ca5 Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. Oct 11 13:47:10.405102 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': 'aef5f133-cfd9-4e94-b2d9-4989a4744189'} Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:10.406195 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. Oct 11 13:47:10.407884 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:10.409810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Returning 404 to user: Instance aef5f133-cfd9-4e94-b2d9-4989a4744189 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:10.409810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-c1948717-6c8a-4389-ad45-1fe5bb422d3f tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189" status: 404 len: 111 microversion: 2.1 time: 0.032087 Oct 11 13:47:10.409810 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 648/1269] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:10 2022] GET /compute/v2.1/servers/aef5f133-cfd9-4e94-b2d9-4989a4744189 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:13.504142 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.504718 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.507032 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b671a8-44f0-4ed2-99b8-c53b80cfd297", "tag": "6dcf2157-77e9-43d8-9666-5d0c269eb5f5"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:13.512420 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.513138 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.513754 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.514630 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.515378 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.516018 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.518118 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.518856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.519286 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.531083 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] Creating event network-changed:6dcf2157-77e9-43d8-9666-5d0c269eb5f5 for instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 on hv-cinder-85061 Oct 11 13:47:13.536856 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-1c1c6cc8-2038-4df3-a733-c00494cbf148 req-67533bc0-c6c4-460b-ba13-2de1f3cc919b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033867 Oct 11 13:47:13.537457 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 649/1270] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:13.543019 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Going to try to terminate instance {{(pid=118881) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 13:47:13.642821 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-390e48dc-26e3-4bef-9441-f826035c0a25 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "DELETE /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 204 len: 0 microversion: 2.1 time: 0.142406 Oct 11 13:47:13.644203 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 622/1271] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:13 2022] DELETE /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 13:47:13.653005 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:13.653710 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:13.660329 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.660818 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.661255 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.661959 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:13.662423 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:13.662845 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:13.817171 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.policy [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118880) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:13.828376 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-bd1cd96c-af3e-4d43-b8e9-40942c52ec45 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1577 microversion: 2.1 time: 0.179628 Oct 11 13:47:13.829319 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 650/1272] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:13 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:14.852139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:14.852984 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:14.859814 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.860314 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.860768 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.861455 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:14.861904 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:14.862326 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:14.993081 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:15.001223 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-612a8a6d-73db-4b3b-a404-42b863241151 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1577 microversion: 2.1 time: 0.153401 Oct 11 13:47:15.001800 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 623/1273] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:14 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:15.852458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b671a8-44f0-4ed2-99b8-c53b80cfd297", "name": "network-vif-deleted", "tag": "6dcf2157-77e9-43d8-9666-5d0c269eb5f5"}]} {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 13:47:15.862894 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:15.863373 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:15.863812 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:15.875871 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.compute.server_external_events [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] Creating event network-vif-deleted:6dcf2157-77e9-43d8-9666-5d0c269eb5f5 for instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 on hv-cinder-85061 Oct 11 13:47:15.880670 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [req-0077f5ec-3c83-48cb-a2c6-c3ffe485954d req-c388ebfe-47b6-4476-a61f-f68953ab35d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Oct 11 13:47:15.881270 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 651/1274] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 11 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 13:47:16.028857 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:16.029737 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:16.039527 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.040295 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.040732 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.041435 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:16.041892 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:16.042299 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:16.112691 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.policy [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76d8100e29a24533a014b8d073e45ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340df5a9e41940d7b010168feb108bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118881) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 13:47:16.121023 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-895013f3-f658-492a-b50b-4317fa27dae9 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 200 len: 1224 microversion: 2.1 time: 0.098986 Oct 11 13:47:16.121616 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 624/1275] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:16 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 13:47:17.149412 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.150273 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 41b671a8-44f0-4ed2-99b8-c53b80cfd297] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.158307 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.158913 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.159458 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.160447 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.161015 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.161552 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.178357 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] HTTP exception thrown: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Request method failure captured: Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 HTTP/1.1 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHfLtLqGL8GFsyIPUl5dlOLcVd_piCMFfAigWOCt-dC-eMH8FwxFJBYVwPP-Mg2F9_ZX2Coo1bP9Rdc2wW2sAZqiP0H28_1hQacC0pp2pnd2HLaDfpZPLhlCuLXokasXXvEpkIsMBTd4YY9Ur7G1jRQs_Orhw01IsxMz_UDZ8wNXaI Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:47:17.180222 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_340df5a9e41940d7b010168feb108bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}] Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 76d8100e29a24533a014b8d073e45ca5 Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. Oct 11 13:47:17.181916 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '41b671a8-44f0-4ed2-99b8-c53b80cfd297'} Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:17.182935 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. Oct 11 13:47:17.184642 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.186095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Returning 404 to user: Instance 41b671a8-44f0-4ed2-99b8-c53b80cfd297 could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:17.186095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-6162a25c-6934-4ff4-9574-63d26400e243 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297" status: 404 len: 111 microversion: 2.1 time: 0.039964 Oct 11 13:47:17.186095 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 652/1276] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/41b671a8-44f0-4ed2-99b8-c53b80cfd297 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:17.635992 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.636859 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.compute.api [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118881) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.644044 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.644552 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.644986 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.645690 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.646139 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.646554 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG oslo_concurrency.lockutils [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118881) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.660053 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.wsgi [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] HTTP exception thrown: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Request method failure captured: Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: request: DELETE /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb HTTP/1.1 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept: application/json Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Accept-Encoding: identity Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Connection: close Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Length: 0 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Content-Type: application/json Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Host: 10.222.0.15 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: Openstack-System-Scope: None Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Auth-Token: gAAAAABjRXHfLtLqGL8GFsyIPUl5dlOLcVd_piCMFfAigWOCt-dC-eMH8FwxFJBYVwPP-Mg2F9_ZX2Coo1bP9Rdc2wW2sAZqiP0H28_1hQacC0pp2pnd2HLaDfpZPLhlCuLXokasXXvEpkIsMBTd4YY9Ur7G1jRQs_Orhw01IsxMz_UDZ8wNXaI Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Id: None Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Domain-Name: None Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Identity-Status: Confirmed Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Is-Admin-Project: True Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Id: default Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Domain-Name: Default Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Project-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Role: reader,member Oct 11 13:47:17.661726 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Roles: reader,member Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_340df5a9e41940d7b010168feb108bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}] Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Id: default Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Domain-Name: Default Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Id: 76d8100e29a24533a014b8d073e45ca5 Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: X-User-Name: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: method: > Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: exception: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.663572 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: action_args: {'id': '39fd6149-adef-4c98-87b0-2744d039d0cb'} Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:17.664629 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.666276 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.667833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Returning 404 to user: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. {{(pid=118881) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:17.667833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-b6ceeda9-135c-48a2-8b5d-1507acca8935 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "DELETE /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 404 len: 111 microversion: 2.1 time: 0.031135 Oct 11 13:47:17.667833 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 625/1277] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 11 13:47:17 2022] DELETE /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:17.671972 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '>' {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:17.672612 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.compute.api [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] [instance: 39fd6149-adef-4c98-87b0-2744d039d0cb] Fetching instance by UUID {{(pid=118880) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 13:47:17.678834 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.679328 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.679742 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.680475 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Acquiring lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 13:47:17.680921 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 13:47:17.681344 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG oslo_concurrency.lockutils [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Lock "04d9bc84-21d2-469d-9af3-0dd87dba8b1a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 13:47:17.698339 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.wsgi [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] HTTP exception thrown: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Request method failure captured: Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: request: GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb HTTP/1.1 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept: application/json Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Accept-Encoding: identity Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Connection: close Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Length: 0 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Content-Type: application/json Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Host: 10.222.0.15 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: Openstack-System-Scope: None Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: User-Agent: python-urllib3/1.26.12 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Auth-Token: gAAAAABjRXHfLtLqGL8GFsyIPUl5dlOLcVd_piCMFfAigWOCt-dC-eMH8FwxFJBYVwPP-Mg2F9_ZX2Coo1bP9Rdc2wW2sAZqiP0H28_1hQacC0pp2pnd2HLaDfpZPLhlCuLXokasXXvEpkIsMBTd4YY9Ur7G1jRQs_Orhw01IsxMz_UDZ8wNXaI Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Id: None Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Domain-Name: None Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Identity-Status: Confirmed Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Is-Admin-Project: True Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Id: default Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Domain-Name: Default Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Project-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Role: reader,member Oct 11 13:47:17.699872 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Roles: reader,member Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_340df5a9e41940d7b010168feb108bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/340df5a9e41940d7b010168feb108bd3"}]}] Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Id: 340df5a9e41940d7b010168feb108bd3 Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014025066 Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Id: default Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Domain-Name: Default Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Id: 76d8100e29a24533a014b8d073e45ca5 Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: X-User-Name: tempest-TestVolumeBootPattern-2014025066-project Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: method: > Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: exception: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.701629 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: action_args: {'id': '39fd6149-adef-4c98-87b0-2744d039d0cb'} Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: {{(pid=118880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 13:47:17.702799 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. Oct 11 13:47:17.704415 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: ERROR nova.api.openstack.wsgi Oct 11 13:47:17.705857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: DEBUG nova.api.openstack.wsgi [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Returning 404 to user: Instance 39fd6149-adef-4c98-87b0-2744d039d0cb could not be found. {{(pid=118880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 13:47:17.705857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: INFO nova.api.openstack.requestlog [None req-1a2e10cf-ae33-40f2-9dc3-425501e0f046 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb" status: 404 len: 111 microversion: 2.1 time: 0.033186 Oct 11 13:47:17.705857 dv-cinder-850618-5-iscsi devstack@n-api.service[118880]: [pid: 118880|app: 0|req: 653/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 11 13:47:17 2022] GET /compute/v2.1/servers/39fd6149-adef-4c98-87b0-2744d039d0cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 13:47:19.019956 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: DEBUG nova.api.openstack.wsgi [None req-05a70a90-ebd2-4ea9-81a4-045b578a0743 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] Calling method '.version_select at 0x7f7a552c98b0>' {{(pid=118881) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 13:47:19.044040 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: INFO nova.api.openstack.requestlog [None req-05a70a90-ebd2-4ea9-81a4-045b578a0743 tempest-TestVolumeBootPattern-2014025066 tempest-TestVolumeBootPattern-2014025066-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-620164794" status: 202 len: 0 microversion: 2.1 time: 0.027988 Oct 11 13:47:19.044647 dv-cinder-850618-5-iscsi devstack@n-api.service[118881]: [pid: 118881|app: 0|req: 626/1279] 10.222.0.15 () {58 vars in 1260 bytes} [Tue Oct 11 13:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-620164794 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)